10/21/2024 02:01:07.070 7fb265860f20 [contrail-analytics-alarm-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 10/21/2024 02:01:07.070 7fb265860f20 [contrail-analytics-alarm-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 10/21/2024 02:01:07.070 7fb265860f20 [contrail-analytics-alarm-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 10/21/2024 02:01:07.084 7fb25f1ee248 [contrail-analytics-alarm-nodemgr] [ERROR]: Cannot write http_port 8113 to /tmp/contrail-analytics-alarm-nodemgr.0.http_port 10/21/2024 02:01:07.085 7fb25f1ee248 [contrail-analytics-alarm-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8113 10/21/2024 02:01:07.085 7fb25f1ee448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvStart] in state[none] 10/21/2024 02:01:07.089 7fb25f1ee448 [contrail-analytics-alarm-nodemgr] [DEBUG]: Add uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:01:07.089 7fb25f1ee448 [contrail-analytics-alarm-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/21/2024 02:01:07.089 7fb25f1ee448 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 10/21/2024 02:01:07.090 7fb25f1ee448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:07.090 7fb25f1ee448 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/21/2024 02:01:07.090 7fb25f1ee448 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:07.091 7fb25f1ee448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:07.091 7fb25f1ee448 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 10/21/2024 02:01:07.091 7fb25f1ee448 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:07.237 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-alarm-gen', 'group': 'contrail-alarm-gen', 'pid': 30317005118320732200691592022380212051505259664720540906468224525268196135507, 'start': '1729476064000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'kafka', 'group': 'kafka', 'pid': 49447193328152687138296429439246656485944230433053859449559597407664112954258, 'start': '1729476064000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-analytics-alarm-nodemgr', 'group': 'contrail-analytics-alarm-nodemgr', 'pid': 60685945881535130578403897500541229492342599784114356580219080783349811440364, 'start': '1729476064000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 10/21/2024 02:01:07.419 7fb265860f20 [contrail-analytics-alarm-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-alarm-nodemgr', _source='cn-jenkins-deploy-platform-juju-os-439-1', _node_type='AnalyticsAlarm', _instance_id='0', _timestamp=1729476067419445, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-analytics-alarm-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo'), _seqnum=0) 10/21/2024 02:01:07.420 7fb265860f20 [contrail-analytics-alarm-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-alarm-nodemgr', _source='cn-jenkins-deploy-platform-juju-os-439-1', _node_type='AnalyticsAlarm', _instance_id='0', _timestamp=1729476067420084, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-alarm-gen', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1729476064000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='kafka', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1729476064000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-alarm-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1729476064000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2024-10-21 01:11:05.701862", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-6068-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo'), _seqnum=0) 10/21/2024 02:01:07.423 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:07.424 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2024-10-21 01:11:05.701862", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-6068-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 8 num_core_per_socket = 8 num_thread_per_core = 1 >> running_package_version = nightly-nightly.el7 installed_package_version = nightly-nightly.el7 >> 10/21/2024 02:01:07.424 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:07.424 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:07.425 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/21/2024 02:01:07.425 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:07.425 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:07.426 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 deleted = False process_info = [ << process_name = contrail-alarm-gen process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1729476064000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = kafka process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1729476064000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-analytics-alarm-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1729476064000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2024-10-21 01:11:05.701862", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-6068-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 10/21/2024 02:01:07.426 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:09.306 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:01:11.089 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:01:11.098 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 10/21/2024 02:01:11.098 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:01:11.099 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:11.099 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:01:11.099 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:11.099 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 10/21/2024 02:01:11.099 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 10/21/2024 02:01:11.100 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 10/21/2024 02:01:11.100 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/21/2024 02:01:11.100 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/21/2024 02:01:11.107 7fb25f370848 [contrail-analytics-alarm-nodemgr] [DEBUG]: Extracted sandesh length: 0000001011 10/21/2024 02:01:11.108 7fb25f370848 [contrail-analytics-alarm-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 10/21/2024 02:01:11.109 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 10/21/2024 02:01:11.109 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 10/21/2024 02:01:11.109 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:01:11.109 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/21/2024 02:01:11.110 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 10/21/2024 02:01:11.110 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 10/21/2024 02:01:11.112 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 10/21/2024 02:01:12.485 7fb265860f20 [contrail-analytics-alarm-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-alarm-nodemgr', _source='cn-jenkins-deploy-platform-juju-os-439-1', _node_type='AnalyticsAlarm', _instance_id='0', _timestamp=1729476072485298, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-alarm-gen', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1729476064000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='kafka', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1729476064000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-alarm-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1729476064000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2024-10-21 01:11:05.701862", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-6068-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo'), _seqnum=0) 10/21/2024 02:01:12.486 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51296484, partition_space_available_1k=29794000, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1688, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=501576, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52712, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=12346636, free=548588, buffers=683676, cached=19086216, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=9.79, five_min_avg=5.13, fifteen_min_avg=3.21, cpu_share=0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:01:33.247 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:01:50.575 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:02:11.296 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:02:12.504 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51375920, partition_space_available_1k=29714564, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=139192, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=646116, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45104, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14612376, free=12067932, buffers=593508, cached=5391300, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=14.09, five_min_avg=7.55, fifteen_min_avg=4.18, cpu_share=9.88, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:02:45.133 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:03:13.306 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51424604, partition_space_available_1k=29665880, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=142228, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=648436, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45160, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14784852, free=11519060, buffers=621036, cached=5740168, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=9.65, five_min_avg=7.56, fifteen_min_avg=4.4, cpu_share=6.12, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:03:16.324 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:03:30.496 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:04:13.307 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51431032, partition_space_available_1k=29659452, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=144472, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=656488, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45160, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14596808, free=11684248, buffers=622876, cached=5761184, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.24, five_min_avg=6.67, fifteen_min_avg=4.29, cpu_share=3.38, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:04:49.525 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:05:04.780 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:05:13.306 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51438600, partition_space_available_1k=29651884, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=146704, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=659996, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45176, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14684844, free=11517312, buffers=626044, cached=5836916, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.86, five_min_avg=6.34, fifteen_min_avg=4.33, cpu_share=2.5, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:05:18.874 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:05:58.807 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:06:13.352 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51441848, partition_space_available_1k=29648636, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=148820, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=667172, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45232, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14947128, free=9974792, buffers=678224, cached=7064972, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=9.04, five_min_avg=6.9, fifteen_min_avg=4.63, cpu_share=4.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:07:13.310 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51451492, partition_space_available_1k=29638992, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=151872, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=669172, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45256, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14643096, free=10241416, buffers=678364, cached=7102240, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.47, five_min_avg=6.37, fifteen_min_avg=4.59, cpu_share=3.38, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:08:13.325 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51455248, partition_space_available_1k=29635236, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=154204, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=671104, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45256, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14646476, free=10232260, buffers=678364, cached=7108016, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.68, five_min_avg=5.65, fifteen_min_avg=4.45, cpu_share=2.62, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:09:03.918 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:09:13.313 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51462996, partition_space_available_1k=29627488, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=156200, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=674416, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45256, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14706784, free=10162428, buffers=678464, cached=7117440, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.53, five_min_avg=4.94, fifteen_min_avg=4.28, cpu_share=2.62, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:09:17.835 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:09:34.829 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:09:59.638 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:10:13.331 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51463140, partition_space_available_1k=29627344, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=158492, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=676264, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45260, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14648656, free=10218316, buffers=678464, cached=7119680, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.91, five_min_avg=4.58, fifteen_min_avg=4.19, cpu_share=2.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:11:13.321 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51466904, partition_space_available_1k=29623580, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=160696, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=676424, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45264, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14641516, free=10220880, buffers=678476, cached=7124244, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.39, five_min_avg=4.13, fifteen_min_avg=4.06, cpu_share=2.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:12:13.319 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51477152, partition_space_available_1k=29613332, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=162940, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=678404, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45284, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14691312, free=10149440, buffers=678476, cached=7145888, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=7.47, five_min_avg=5.33, fifteen_min_avg=4.48, cpu_share=5.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:13:13.344 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51482204, partition_space_available_1k=29608280, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=165180, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=705460, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45284, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14766896, free=10063808, buffers=678484, cached=7155928, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.2, five_min_avg=4.78, fifteen_min_avg=4.35, cpu_share=2.88, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:13:14.821 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:13:28.638 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:13:45.781 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:14:13.322 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51486184, partition_space_available_1k=29604300, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=167388, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=742936, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45288, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14736348, free=10089840, buffers=678492, cached=7160436, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.82, five_min_avg=4.33, fifteen_min_avg=4.22, cpu_share=2.88, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:15:13.325 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51490140, partition_space_available_1k=29600344, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=169552, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=780852, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45284, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14773996, free=10046588, buffers=678528, cached=7166004, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.16, five_min_avg=3.88, fifteen_min_avg=4.07, cpu_share=2.62, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:15:31.787 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:16:13.335 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51493784, partition_space_available_1k=29596700, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=171932, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=808188, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45292, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14787812, free=10026704, buffers=678536, cached=7172064, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.09, five_min_avg=3.54, fifteen_min_avg=3.94, cpu_share=2.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:17:13.330 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51497780, partition_space_available_1k=29592704, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=174064, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=801840, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45288, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14823328, free=9970620, buffers=679496, cached=7191672, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.12, five_min_avg=3.3, fifteen_min_avg=3.83, cpu_share=2.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:17:25.099 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:17:40.379 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:17:57.663 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:18:13.348 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51507780, partition_space_available_1k=29582704, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=176260, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=801768, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45324, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14879420, free=9895720, buffers=679500, cached=7210476, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.07, five_min_avg=3.79, fifteen_min_avg=3.98, cpu_share=5.38, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:19:13.332 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51512928, partition_space_available_1k=29577556, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=178496, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=803556, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45328, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14849516, free=9915780, buffers=679616, cached=7220204, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.87, five_min_avg=3.48, fifteen_min_avg=3.86, cpu_share=2.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:20:13.341 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51516436, partition_space_available_1k=29574048, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=180684, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=803680, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45336, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14841032, free=9919560, buffers=679616, cached=7224908, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.2, five_min_avg=3.17, fifteen_min_avg=3.72, cpu_share=2.62, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:21:13.335 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51519952, partition_space_available_1k=29570532, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=182864, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=803524, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45332, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14858112, free=9897192, buffers=679632, cached=7230180, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.81, five_min_avg=3.12, fifteen_min_avg=3.67, cpu_share=2.62, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:21:20.009 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:22:13.340 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51524212, partition_space_available_1k=29566272, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=185212, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=811496, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45340, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14821060, free=9929976, buffers=679812, cached=7234268, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.56, five_min_avg=2.98, fifteen_min_avg=3.58, cpu_share=2.62, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:22:57.076 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:23:10.791 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:23:13.348 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51532032, partition_space_available_1k=29558452, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=187376, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=811376, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45344, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14903256, free=9838684, buffers=679820, cached=7243356, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.37, five_min_avg=2.85, fifteen_min_avg=3.5, cpu_share=2.62, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:23:34.641 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:24:13.337 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51538872, partition_space_available_1k=29551612, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=189580, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=811428, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45344, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14857440, free=9865476, buffers=679836, cached=7262364, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.99, five_min_avg=3.47, fifteen_min_avg=3.69, cpu_share=5.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:25:13.345 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51542444, partition_space_available_1k=29548040, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=191860, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=816248, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45348, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14865032, free=9847700, buffers=679848, cached=7272536, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.79, five_min_avg=3.39, fifteen_min_avg=3.64, cpu_share=2.62, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:26:13.347 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51546252, partition_space_available_1k=29544232, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=194044, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=816116, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45356, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14857116, free=9851108, buffers=679848, cached=7277044, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.66, five_min_avg=3.16, fifteen_min_avg=3.54, cpu_share=2.62, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:27:12.762 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:27:13.346 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51554644, partition_space_available_1k=29535840, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196288, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=816116, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45356, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14923208, free=9776432, buffers=679852, cached=7285624, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.96, five_min_avg=2.85, fifteen_min_avg=3.41, cpu_share=2.62, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:27:50.478 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:28:04.301 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:28:13.414 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51555732, partition_space_available_1k=29534752, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=193608, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=816276, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45384, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=15012172, free=9680304, buffers=679852, cached=7292788, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=7.76, five_min_avg=4.01, fifteen_min_avg=3.75, cpu_share=4.5, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:28:23.007 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:29:13.352 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51560988, partition_space_available_1k=29529496, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=195756, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=816140, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45396, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14878532, free=9803368, buffers=679912, cached=7303304, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.14, five_min_avg=3.69, fifteen_min_avg=3.66, cpu_share=3.25, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:30:13.363 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51559832, partition_space_available_1k=29530652, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=192868, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=834296, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45400, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14904876, free=9776880, buffers=679912, cached=7303448, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.02, five_min_avg=3.47, fifteen_min_avg=3.59, cpu_share=2.62, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:31:13.381 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51563644, partition_space_available_1k=29526840, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=195120, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=888388, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45404, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14929804, free=9747540, buffers=679916, cached=7307856, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.86, five_min_avg=3.36, fifteen_min_avg=3.54, cpu_share=2.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:31:49.962 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:32:13.382 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51563164, partition_space_available_1k=29527320, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=192376, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=888380, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45404, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14947400, free=9729672, buffers=679916, cached=7308128, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.44, five_min_avg=3.2, fifteen_min_avg=3.48, cpu_share=2.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:32:31.593 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:32:45.567 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:33:02.558 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:33:13.386 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51673736, partition_space_available_1k=29416748, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=194580, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=888388, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45404, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14937768, free=9733796, buffers=679920, cached=7313632, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.15, five_min_avg=3.02, fifteen_min_avg=3.4, cpu_share=3.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:34:13.387 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51578100, partition_space_available_1k=29512384, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196928, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=888384, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45408, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14955540, free=9786712, buffers=679920, cached=7242944, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.02, five_min_avg=3.79, fifteen_min_avg=3.65, cpu_share=5.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:35:13.397 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51576980, partition_space_available_1k=29513504, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=194004, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=888372, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45408, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14979744, free=9762036, buffers=679920, cached=7243416, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.1, five_min_avg=3.47, fifteen_min_avg=3.54, cpu_share=2.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:36:03.845 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:36:13.406 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51585308, partition_space_available_1k=29505176, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196168, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=896984, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45408, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14966504, free=9770248, buffers=679924, cached=7248440, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.35, five_min_avg=3.17, fifteen_min_avg=3.43, cpu_share=2.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:37:13.404 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51580724, partition_space_available_1k=29509760, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=193452, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=897148, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45404, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14960088, free=9776604, buffers=679924, cached=7248500, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.14, five_min_avg=2.97, fifteen_min_avg=3.35, cpu_share=2.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:38:05.068 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:38:13.411 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51588944, partition_space_available_1k=29501540, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=195672, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=912332, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45412, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=15031180, free=9694904, buffers=679924, cached=7259108, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.06, five_min_avg=2.8, fifteen_min_avg=3.26, cpu_share=3.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:38:19.086 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:38:36.432 7fb25f1ee848 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:39:13.465 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51584160, partition_space_available_1k=29506324, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=192940, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=912332, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45412, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=15398672, free=9321896, buffers=679924, cached=7264624, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.6, five_min_avg=2.86, fifteen_min_avg=3.25, cpu_share=4.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:39:44.089 7fb25f370848 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 10/21/2024 02:39:44.089 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Established] 10/21/2024 02:39:49.096 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:39:49.096 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[Established] -> State[Connect] 10/21/2024 02:39:49.096 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:49.096 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Established to Connect on EvTcpClose >>, ] description = Collector:Collector[Established to Connect on EvTcpClose] connection down >>, ] >> 10/21/2024 02:39:49.096 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:49.096 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:39:49.097 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:39:49.097 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:49.097 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:39:49.098 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:49.098 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:49.098 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:39:49.098 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:53.097 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:39:58.102 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:39:58.102 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:39:58.103 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:58.103 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:39:58.103 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:58.103 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:39:58.103 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:39:58.103 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:58.104 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:39:58.104 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:58.104 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:58.104 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:39:58.104 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:02.105 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:40:07.107 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:40:07.108 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:40:07.108 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:07.108 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:40:07.108 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:07.108 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:40:07.109 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:40:07.109 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:07.109 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:40:07.109 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:07.109 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:07.109 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:40:07.109 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:11.108 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:40:13.409 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51594888, partition_space_available_1k=29495596, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=195068, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=912336, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45432, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=15019276, free=9667956, buffers=681916, cached=7295968, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.48, five_min_avg=3.27, fifteen_min_avg=3.38, cpu_share=4.38, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:40:16.112 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:40:16.113 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:40:16.113 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:16.113 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:40:16.113 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:16.113 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:16.114 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51594888 partition_space_available_1k = 29495596 percentage_partition_space_used = 64 >> } process_mem_cpu_usage = { contrail-alarm-gen : << mem_virt = 195068 cpu_share = 0 mem_res = 0 >>kafka : << mem_virt = 912336 cpu_share = 0 mem_res = 0 >>contrail-analytics-alarm-nodemgr : << mem_virt = 45432 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 32665116 used = 15019276 free = 9667956 buffers = 681916 cached = 7295968 node_type = analytics-alarm-node >> system_cpu_usage = << one_min_avg = 3.48 five_min_avg = 3.27 fifteen_min_avg = 3.38 cpu_share = 4.38 node_type = analytics-alarm-node >> >> 10/21/2024 02:40:16.114 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:16.114 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:40:16.115 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:40:16.115 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:16.115 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:40:16.115 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:16.115 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:16.115 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:40:16.115 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:20.112 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:40:25.118 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:40:25.119 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:40:25.119 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:25.119 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:40:25.119 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:25.119 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:40:25.119 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:40:25.120 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:25.120 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:40:25.120 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:25.120 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:25.120 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:40:25.120 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:29.121 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:40:30.645 7fb25f370848 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:40:34.125 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:40:34.126 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:40:34.126 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:34.126 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:40:34.126 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:34.126 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:40:34.127 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:40:34.127 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:34.127 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:40:34.127 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:34.127 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:34.127 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:40:34.127 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:38.128 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:40:43.133 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:40:43.133 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:40:43.133 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:43.133 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:40:43.134 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:43.134 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:40:43.134 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:40:43.134 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:43.134 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:40:43.135 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:43.135 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:43.135 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:40:43.135 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:47.134 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:40:52.136 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:40:52.136 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:40:52.136 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:52.137 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:40:52.137 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:52.137 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:40:52.137 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:40:52.137 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:52.137 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:40:52.138 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:52.138 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:52.138 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:40:52.138 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:56.138 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:41:01.144 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:41:01.144 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:41:01.144 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:01.144 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:41:01.144 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:01.144 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:41:01.145 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:41:01.145 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:01.145 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:41:01.146 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:01.146 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:01.146 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:41:01.146 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:05.146 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:41:10.153 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:41:10.154 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:41:10.154 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:10.154 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:41:10.154 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:10.154 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:41:10.155 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:41:10.156 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:10.156 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:41:10.156 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:10.156 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:10.156 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:41:10.156 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:13.426 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51599836, partition_space_available_1k=29490648, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=197284, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=912376, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45448, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=15016648, free=9665036, buffers=681916, cached=7301516, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.21, five_min_avg=2.97, fifteen_min_avg=3.27, cpu_share=2.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:41:13.427 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:13.427 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51599836 partition_space_available_1k = 29490648 percentage_partition_space_used = 64 >> } process_mem_cpu_usage = { contrail-alarm-gen : << mem_virt = 197284 cpu_share = 0 mem_res = 0 >>kafka : << mem_virt = 912376 cpu_share = 0 mem_res = 0 >>contrail-analytics-alarm-nodemgr : << mem_virt = 45448 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 32665116 used = 15016648 free = 9665036 buffers = 681916 cached = 7301516 node_type = analytics-alarm-node >> system_cpu_usage = << one_min_avg = 2.21 five_min_avg = 2.97 fifteen_min_avg = 3.27 cpu_share = 2.75 node_type = analytics-alarm-node >> >> 10/21/2024 02:41:13.427 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:14.153 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:41:19.157 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:41:19.158 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:41:19.158 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:19.158 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:41:19.158 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:19.158 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:41:19.159 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:41:19.159 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:19.159 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:41:19.160 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:19.160 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:19.160 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:41:19.160 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:23.158 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:41:28.162 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:41:28.163 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:41:28.163 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:28.163 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:41:28.163 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:28.163 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:41:28.163 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:41:28.164 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:28.164 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:41:28.164 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:28.164 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:28.164 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:41:28.164 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:32.165 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:41:37.167 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:41:37.167 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:41:37.168 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:37.168 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:41:37.168 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:37.168 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:41:37.168 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:41:37.168 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:37.169 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:41:37.169 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:37.169 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:37.169 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:41:37.169 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:41.170 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:41:46.175 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:41:46.175 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:41:46.175 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:46.176 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:41:46.176 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:46.176 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:41:46.176 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:41:46.176 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:46.177 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:41:46.177 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:46.177 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:46.177 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:41:46.177 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:50.177 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:41:55.182 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:41:55.182 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:41:55.182 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:55.183 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:41:55.183 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:55.183 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:41:55.183 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:41:55.183 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:55.183 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:41:55.183 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:55.184 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:55.184 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:41:55.184 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:59.185 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:42:04.190 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:42:04.190 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:42:04.190 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:04.190 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:42:04.190 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:04.190 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:42:04.191 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:42:04.191 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:04.191 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:42:04.191 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:04.191 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:04.191 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:42:04.191 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:08.190 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:42:13.193 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:42:13.193 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:42:13.193 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:13.193 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:42:13.194 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:13.194 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:42:13.194 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:42:13.194 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:13.195 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:42:13.195 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:13.195 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:13.195 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:42:13.195 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:13.413 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51598620, partition_space_available_1k=29491864, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=194500, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=912360, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45484, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14996440, free=9685960, buffers=681916, cached=7300800, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.28, five_min_avg=2.86, fifteen_min_avg=3.22, cpu_share=2.88, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:42:13.413 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:13.413 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51598620 partition_space_available_1k = 29491864 percentage_partition_space_used = 64 >> } process_mem_cpu_usage = { contrail-alarm-gen : << mem_virt = 194500 cpu_share = 0 mem_res = 0 >>kafka : << mem_virt = 912360 cpu_share = 0 mem_res = 0 >>contrail-analytics-alarm-nodemgr : << mem_virt = 45484 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 32665116 used = 14996440 free = 9685960 buffers = 681916 cached = 7300800 node_type = analytics-alarm-node >> system_cpu_usage = << one_min_avg = 2.28 five_min_avg = 2.86 fifteen_min_avg = 3.22 cpu_share = 2.88 node_type = analytics-alarm-node >> >> 10/21/2024 02:42:13.414 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:17.196 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:42:22.198 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:42:22.198 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:42:22.198 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:22.198 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:42:22.198 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:22.199 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:42:22.199 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:42:22.199 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:22.199 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:42:22.199 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:22.199 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:22.199 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:42:22.200 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:26.201 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:42:31.206 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:42:31.207 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:42:31.207 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:31.207 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:42:31.207 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:31.207 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:42:31.208 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:42:31.208 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:31.208 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:42:31.209 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:31.209 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:31.209 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:42:31.209 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:35.209 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:42:40.214 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:42:40.214 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:42:40.215 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:40.215 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:42:40.215 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:40.215 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:42:40.215 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:42:40.215 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:40.216 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:42:40.216 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:40.216 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:40.216 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:42:40.216 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:44.217 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:42:49.222 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:42:49.222 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:42:49.223 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:49.223 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:42:49.223 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:49.223 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:42:49.224 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:42:49.224 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:49.224 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:42:49.224 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:49.224 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:49.224 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:42:49.224 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:53.223 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:42:58.229 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:42:58.229 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:42:58.229 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:58.230 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:42:58.230 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:58.230 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:42:58.231 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:42:58.231 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:58.231 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:42:58.231 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:58.231 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:58.231 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:42:58.231 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:02.233 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:43:07.235 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:43:07.235 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:43:07.235 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:07.235 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:43:07.235 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:07.235 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:43:07.236 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:43:07.236 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:07.236 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:43:07.236 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:07.236 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:07.236 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:43:07.236 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:11.235 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:43:13.409 7fb265860f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-439-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51602584, partition_space_available_1k=29487900, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196884, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=912500, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=45512, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14977236, free=9700332, buffers=681916, cached=7305632, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.35, five_min_avg=2.76, fifteen_min_avg=3.16, cpu_share=2.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 10/21/2024 02:43:16.240 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:43:16.240 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:43:16.240 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:16.240 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:43:16.240 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:16.240 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:16.241 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51602584 partition_space_available_1k = 29487900 percentage_partition_space_used = 64 >> } process_mem_cpu_usage = { contrail-alarm-gen : << mem_virt = 196884 cpu_share = 0 mem_res = 0 >>kafka : << mem_virt = 912500 cpu_share = 0 mem_res = 0 >>contrail-analytics-alarm-nodemgr : << mem_virt = 45512 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 32665116 used = 14977236 free = 9700332 buffers = 681916 cached = 7305632 node_type = analytics-alarm-node >> system_cpu_usage = << one_min_avg = 2.35 five_min_avg = 2.76 fifteen_min_avg = 3.16 cpu_share = 2.75 node_type = analytics-alarm-node >> >> 10/21/2024 02:43:16.241 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:16.241 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:43:16.241 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:43:16.241 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:16.241 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:43:16.242 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:16.242 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:16.242 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:43:16.242 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:20.242 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:43:25.246 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:43:25.246 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:43:25.246 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:25.246 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:43:25.246 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:25.247 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:43:25.247 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:43:25.247 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:25.247 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:43:25.247 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:25.247 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:25.248 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:43:25.248 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:29.249 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:43:34.253 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:43:34.253 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:43:34.253 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:34.253 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:43:34.253 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:34.253 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:43:34.254 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:43:34.254 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:34.254 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:43:34.254 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:34.254 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:34.254 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:43:34.254 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:38.253 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:43:43.257 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:43:43.257 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:43:43.257 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:43.257 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:43:43.258 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:43.258 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:43:43.258 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:43:43.258 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:43.258 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:43:43.258 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:43.259 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:43.259 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:43:43.259 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:47.260 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:43:52.262 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:43:52.262 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:43:52.262 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:52.262 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:43:52.263 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:52.263 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:43:52.263 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:43:52.263 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:52.263 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:43:52.264 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:52.264 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:52.264 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:43:52.264 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:56.265 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:44:01.270 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:44:01.271 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:44:01.271 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:44:01.271 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:44:01.271 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:44:01.271 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:44:01.272 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:44:01.272 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:44:01.272 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:44:01.272 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:44:01.272 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:44:01.272 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1729476067089543 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 10/21/2024 02:44:01.272 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:44:01.506 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:44:02.493 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 10/21/2024 02:44:05.272 7fb25f1ee548 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]