09/01/2025 01:51:29.430 7f8e98c66b00 [contrail-analytics-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 09/01/2025 01:51:29.430 7f8e98c66b00 [contrail-analytics-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 09/01/2025 01:51:29.430 7f8e98c66b00 [contrail-analytics-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 09/01/2025 01:51:29.439 7f8e9606b4a0 [contrail-analytics-nodemgr] [ERROR]: Cannot write http_port 8104 to /tmp/contrail-analytics-nodemgr.0.http_port 09/01/2025 01:51:29.440 7f8e9606b4a0 [contrail-analytics-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8104 09/01/2025 01:51:29.440 7f8e9606b860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvStart] in state[none] 09/01/2025 01:51:29.441 7f8e9606b860 [contrail-analytics-nodemgr] [DEBUG]: Add uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:51:29.442 7f8e9606b860 [contrail-analytics-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/01/2025 01:51:29.442 7f8e9606b860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 09/01/2025 01:51:29.442 7f8e9606b860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:29.442 7f8e9606b860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/01/2025 01:51:29.442 7f8e9606b860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:29.442 7f8e9606b860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:29.442 7f8e9606b860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 09/01/2025 01:51:29.442 7f8e9606b860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:29.675 7f8e98c66b00 [contrail-analytics-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-collector', 'group': 'contrail-collector', 'pid': 100875458715169061419028081376551048736985172831319118874200093883038022050246, 'start': '1756691489000000', 'statename': 'PROCESS_STATE_BACKOFF'}, {'name': 'contrail-analytics-api', 'group': 'contrail-analytics-api', 'pid': 79352985636802179908146216308961250728323824989139488145477129035858195930313, 'start': '1756691487000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-analytics-nodemgr', 'group': 'contrail-analytics-nodemgr', 'pid': 75343566366668527476235625481929095905486831596166946217126698649116798291171, 'start': '1756691487000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 09/01/2025 01:51:29.743 7f8e98c66b00 [contrail-analytics-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-3994-1.', _node_type='Analytics', _instance_id='0', _timestamp=1756691489743075, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3994-1.', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-analytics-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo'), _seqnum=0) 09/01/2025 01:51:29.743 7f8e98c66b00 [contrail-analytics-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-3994-1.', _node_type='Analytics', _instance_id='0', _timestamp=1756691489743591, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3994-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-collector', process_state='PROCESS_STATE_BACKOFF', start_count=1, stop_count=0, exit_count=0, last_start_time='1756691489000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1756691487000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1756691487000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-09-01 00:14:10.876612", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-10717-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed\n"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo'), _seqnum=0) 09/01/2025 01:51:29.746 7f8e9606b900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:29.747 7f8e9606b900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. build_info = {"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-09-01 00:14:10.876612", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-10717-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed "}]} system_cpu_info = << num_socket = 1 num_cpu = 8 num_core_per_socket = 8 num_thread_per_core = 1 >> running_package_version = package contrail-lib is not installed installed_package_version = package contrail-lib is not installed >> 09/01/2025 01:51:29.747 7f8e9606b900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:29.747 7f8e9606b900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:29.747 7f8e9606b900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/01/2025 01:51:29.747 7f8e9606b900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:29.747 7f8e9606b900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:29.748 7f8e9606b900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. deleted = False process_info = [ << process_name = contrail-collector process_state = PROCESS_STATE_BACKOFF start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1756691489000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-analytics-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1756691487000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-analytics-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1756691487000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-09-01 00:14:10.876612", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-10717-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed "}]} >> 09/01/2025 01:51:29.748 7f8e9606b900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:29.979 7f8e9606be00 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_process_state:contrail-collector,group:contrail-collector,state:PROCESS_STATE_RUNNING 09/01/2025 01:51:29.979 7f8e9606be00 [contrail-analytics-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-3994-1.', _node_type='Analytics', _instance_id='0', _timestamp=1756691489979730, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3994-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-collector', process_state='PROCESS_STATE_RUNNING', start_count=2, stop_count=0, exit_count=0, last_start_time='1756691489979651', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1756691487000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1756691487000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-09-01 00:14:10.876612", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-10717-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed\n"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo'), _seqnum=0) 09/01/2025 01:51:29.981 7f8e95dc84a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:29.981 7f8e95dc84a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. deleted = False process_info = [ << process_name = contrail-collector process_state = PROCESS_STATE_RUNNING start_count = 2 stop_count = 0 exit_count = 0 last_start_time = 1756691489979651 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-analytics-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1756691487000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-analytics-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1756691487000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-09-01 00:14:10.876612", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-10717-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed "}]} >> 09/01/2025 01:51:29.981 7f8e95dc84a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:32.894 7f8e98c66b00 [contrail-analytics-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-3994-1.', _node_type='Analytics', _instance_id='0', _timestamp=1756691492893998, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3994-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-collector', process_state='PROCESS_STATE_RUNNING', start_count=2, stop_count=0, exit_count=0, last_start_time='1756691489979651', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1756691487000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1756691487000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-09-01 00:14:10.876612", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-10717-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed\n"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo'), _seqnum=0) 09/01/2025 01:51:32.894 7f8e98c66b00 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3994-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=17375744, partition_space_available_1k=63714740, percentage_partition_space_used=21, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=2080, cpu_share=0.0, mem_res=1240, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=54504, cpu_share=0.0, mem_res=45120, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=7995796, free=6472548, buffers=638232, cached=17558544, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.61, five_min_avg=2.08, fifteen_min_avg=1.32, cpu_share=0, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 01:51:32.894 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:32.895 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. deleted = False process_info = [ << process_name = contrail-collector process_state = PROCESS_STATE_RUNNING start_count = 2 stop_count = 0 exit_count = 0 last_start_time = 1756691489979651 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-analytics-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1756691487000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-analytics-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1756691487000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-09-01 00:14:10.876612", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-10717-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed "}]} >> 09/01/2025 01:51:32.895 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:32.895 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:32.895 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 17375744 partition_space_available_1k = 63714740 percentage_partition_space_used = 21 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 2080 cpu_share = 0.0 mem_res = 1240 >>contrail-analytics-nodemgr : << mem_virt = 54504 cpu_share = 0.0 mem_res = 45120 >> } system_mem_usage = << total = 32665120 used = 7995796 free = 6472548 buffers = 638232 cached = 17558544 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 2.61 five_min_avg = 2.08 fifteen_min_avg = 1.32 cpu_share = 0 node_type = analytics-node >> >> 09/01/2025 01:51:32.895 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:33.442 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:51:33.443 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:51:33.443 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:51:33.443 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:33.443 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:51:33.444 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:33.444 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:51:33.444 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:51:33.444 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:33.444 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:51:33.444 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:33.444 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:33.444 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:51:33.444 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:37.445 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:51:37.447 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:51:37.447 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:51:37.447 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:37.447 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:51:37.447 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:37.447 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:51:37.447 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:51:37.448 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:37.448 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:51:37.448 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:37.448 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:37.448 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:51:37.448 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:41.448 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:51:41.449 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:51:41.449 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:51:41.449 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:41.449 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:51:41.449 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:41.449 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:51:41.450 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:51:41.450 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:41.450 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:51:41.450 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:41.450 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:41.450 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:51:41.450 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:45.136 7f8e9606be00 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_process_state:contrail-collector,group:contrail-collector,state:PROCESS_STATE_BACKOFF 09/01/2025 01:51:45.450 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:51:45.451 7f8e9606bea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:51:45.451 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:51:45.451 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:45.451 7f8e9606bea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:51:45.451 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:45.451 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:51:45.452 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:51:45.452 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:45.452 7f8e9606bea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:51:45.452 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:45.452 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:45.452 7f8e9606bea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:51:45.452 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:49.452 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:51:49.453 7f8e9606bea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:51:49.453 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:51:49.453 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:49.453 7f8e9606bea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:51:49.453 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:49.453 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:51:49.454 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:51:49.454 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:49.454 7f8e9606bea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:51:49.454 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:49.454 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:49.454 7f8e9606bea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:51:49.454 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:53.457 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:51:53.458 7f8e9606bea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:51:53.459 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:51:53.459 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:53.459 7f8e9606bea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:51:53.459 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:53.459 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:51:53.459 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:51:53.459 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:53.459 7f8e9606bea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:51:53.459 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:53.459 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:53.459 7f8e9606bea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:51:53.460 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:57.463 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:51:57.464 7f8e9606bea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:51:57.464 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:51:57.464 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:57.464 7f8e9606bea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:51:57.464 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:51:57.464 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:51:57.465 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:51:57.465 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:57.465 7f8e9606bea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:51:57.465 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:57.465 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:51:57.465 7f8e9606bea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:51:57.465 7f8e9606bea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:01.466 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:01.467 7f8e95dc8180 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:01.467 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:01.467 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:01.467 7f8e95dc8180 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:01.467 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:01.467 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:01.468 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:01.468 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:01.468 7f8e95dc8180 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:01.468 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:01.468 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:01.468 7f8e95dc8180 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:52:01.468 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:05.470 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:05.471 7f8e95dc8180 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:05.471 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:05.471 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:05.471 7f8e95dc8180 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:05.471 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:05.471 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:05.471 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:05.472 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:05.472 7f8e95dc8180 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:05.472 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:05.472 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:05.472 7f8e95dc8180 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:52:05.472 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:09.475 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:09.476 7f8e95dc8180 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:09.476 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:09.476 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:09.476 7f8e95dc8180 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:09.476 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:09.476 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:09.477 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:09.477 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:09.477 7f8e95dc8180 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:09.477 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:09.477 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:09.477 7f8e95dc8180 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:52:09.477 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:13.480 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:13.481 7f8e95dc8180 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:13.481 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:13.482 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:13.482 7f8e95dc8180 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:13.482 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:13.482 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:13.482 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:13.482 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:13.483 7f8e95dc8180 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:13.483 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:13.483 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:13.483 7f8e95dc8180 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:52:13.483 7f8e95dc8180 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:17.484 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:17.485 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:17.486 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:17.486 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:17.486 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:17.486 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:17.486 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:17.486 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:17.486 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:17.487 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:17.487 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:17.487 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:17.487 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:52:17.487 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:21.490 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:21.491 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:21.491 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:21.491 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:21.491 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:21.491 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:21.491 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:21.492 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:21.492 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:21.492 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:21.492 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:21.492 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:21.492 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:52:21.492 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:25.495 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:25.496 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:25.496 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:25.496 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:25.496 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:25.496 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:25.497 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:25.497 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:25.497 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:25.497 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:25.497 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:25.497 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:25.497 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:52:25.497 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:29.500 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:29.501 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:29.501 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:29.502 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:29.502 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:29.502 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:29.502 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:29.502 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:29.502 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:29.502 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:29.502 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:29.502 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:29.502 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:52:29.503 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:32.871 7f8e98c66b00 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3994-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19369924, partition_space_available_1k=61720560, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=180548, cpu_share=0.05, mem_res=179216, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=47248, cpu_share=0.01, mem_res=45120, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9403004, free=19986496, buffers=681424, cached=2594196, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.25, five_min_avg=2.38, fifteen_min_avg=1.48, cpu_share=4.12, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 01:52:32.871 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:32.872 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 19369924 partition_space_available_1k = 61720560 percentage_partition_space_used = 24 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 180548 cpu_share = 0.05 mem_res = 179216 >>contrail-analytics-nodemgr : << mem_virt = 47248 cpu_share = 0.01 mem_res = 45120 >> } system_mem_usage = << total = 32665120 used = 9403004 free = 19986496 buffers = 681424 cached = 2594196 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 3.25 five_min_avg = 2.38 fifteen_min_avg = 1.48 cpu_share = 4.12 node_type = analytics-node >> >> 09/01/2025 01:52:32.872 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:33.503 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:33.504 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:33.504 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:33.504 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:33.504 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:33.504 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:33.504 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:33.505 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:33.505 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:33.505 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:33.505 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:33.505 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:33.505 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:52:33.505 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:37.508 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:37.509 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:37.509 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:37.509 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:37.509 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:37.509 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:37.509 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:37.510 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:37.510 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:37.510 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:37.510 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:37.510 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:37.510 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:52:37.510 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:41.512 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:41.513 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:41.513 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:41.513 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:41.513 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:41.513 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:41.513 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:41.514 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:41.514 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:41.514 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:41.514 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:41.514 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:41.514 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:52:41.514 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:45.516 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:45.517 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:45.517 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:45.517 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:45.517 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:45.517 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:45.517 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:45.518 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:45.518 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:45.518 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:45.518 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:45.518 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:45.518 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:52:45.518 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:49.521 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:49.522 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:49.523 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:49.523 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:49.523 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:49.523 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:49.523 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:49.523 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:49.523 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:49.523 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:49.523 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:49.523 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:49.523 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:52:49.524 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:53.524 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:53.525 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:53.525 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:53.525 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:53.525 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:53.525 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:53.525 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:53.526 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:53.526 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:53.526 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:53.526 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:53.526 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:53.526 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:52:53.526 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:57.528 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:52:57.529 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:52:57.529 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:52:57.529 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:57.529 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:52:57.529 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:52:57.529 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:52:57.530 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:52:57.530 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:57.530 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:52:57.530 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:57.530 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:52:57.530 7f8e95dc8680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:52:57.530 7f8e95dc8680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:01.530 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:01.531 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:01.531 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:01.532 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:01.532 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:01.532 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:01.532 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:01.532 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:01.532 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:01.532 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:01.532 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:01.532 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:01.532 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:53:01.533 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:05.533 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:05.534 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:05.534 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:05.534 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:05.535 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:05.535 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:05.535 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:05.535 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:05.535 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:05.535 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:05.535 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:05.535 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:05.535 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:53:05.535 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:09.539 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:09.540 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:09.540 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:09.540 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:09.540 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:09.540 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:09.540 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:09.541 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:09.541 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:09.541 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:09.541 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:09.541 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:09.541 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:53:09.541 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:13.544 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:13.545 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:13.545 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:13.545 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:13.545 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:13.545 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:13.546 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:13.546 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:13.546 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:13.546 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:13.546 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:13.546 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:13.546 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:53:13.546 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:17.547 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:17.548 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:17.548 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:17.548 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:17.549 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:17.549 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:17.549 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:17.549 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:17.549 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:17.549 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:17.549 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:17.549 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:17.549 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:53:17.549 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:21.553 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:21.554 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:21.554 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:21.554 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:21.554 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:21.554 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:21.554 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:21.554 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:21.555 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:21.555 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:21.555 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:21.555 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:21.555 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:53:21.555 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:25.556 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:25.557 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:25.557 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:25.557 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:25.557 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:25.557 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:25.557 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:25.557 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:25.557 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:25.558 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:25.558 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:25.558 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:25.558 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:53:25.558 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:29.560 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:29.561 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:29.561 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:29.561 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:29.561 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:29.561 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:29.561 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:29.562 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:29.562 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:29.562 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:29.562 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:29.562 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:29.562 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:53:29.562 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:32.873 7f8e98c66b00 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3994-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19478252, partition_space_available_1k=61612232, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=180612, cpu_share=0.0, mem_res=179216, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=47208, cpu_share=0.01, mem_res=45120, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=8620372, free=20823732, buffers=685556, cached=2535460, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.43, five_min_avg=2.33, fifteen_min_avg=1.52, cpu_share=3.5, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 01:53:32.873 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:32.874 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 19478252 partition_space_available_1k = 61612232 percentage_partition_space_used = 24 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 180612 cpu_share = 0.0 mem_res = 179216 >>contrail-analytics-nodemgr : << mem_virt = 47208 cpu_share = 0.01 mem_res = 45120 >> } system_mem_usage = << total = 32665120 used = 8620372 free = 20823732 buffers = 685556 cached = 2535460 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 2.43 five_min_avg = 2.33 fifteen_min_avg = 1.52 cpu_share = 3.5 node_type = analytics-node >> >> 09/01/2025 01:53:32.874 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:33.562 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:33.563 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:33.563 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:33.563 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:33.563 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:33.563 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:33.564 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:33.564 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:33.564 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:33.564 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:33.564 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:33.564 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:33.564 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:53:33.564 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:37.568 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:37.569 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:37.569 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:37.569 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:37.569 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:37.569 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:37.569 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:37.569 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:37.570 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:37.570 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:37.570 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:37.570 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:37.570 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:53:37.570 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:41.572 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:41.573 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:41.573 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:41.573 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:41.573 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:41.573 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:41.573 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:41.574 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:41.574 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:41.574 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:41.574 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:41.574 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:41.574 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:53:41.574 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:45.577 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:45.578 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:45.578 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:45.578 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:45.578 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:45.578 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:45.579 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:45.579 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:45.579 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:45.579 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:45.579 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:45.579 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:45.579 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:53:45.579 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:49.582 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:49.583 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:49.583 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:49.583 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:49.583 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:49.583 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:49.583 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:49.584 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:49.584 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:49.584 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:49.584 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:49.584 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:49.584 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:53:49.584 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:53.587 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:53.588 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:53.589 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:53.589 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:53.589 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:53.589 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:53.589 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:53.589 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:53.589 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:53.589 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:53.589 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:53.589 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:53.590 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:53:53.590 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:57.592 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:53:57.593 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:53:57.593 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:53:57.593 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:57.593 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:53:57.593 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:53:57.593 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:53:57.594 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:53:57.594 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:57.594 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:53:57.594 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:57.594 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:53:57.594 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:53:57.594 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:01.594 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:01.595 7f8e95dc8040 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:01.595 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:01.595 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:01.595 7f8e95dc8040 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:01.595 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:01.595 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:01.595 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:01.596 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:01.596 7f8e95dc8040 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:01.596 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:01.596 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:01.596 7f8e95dc8040 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:54:01.596 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:05.596 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:05.597 7f8e95dc8040 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:05.597 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:05.597 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:05.598 7f8e95dc8040 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:05.598 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:05.598 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:05.598 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:05.598 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:05.598 7f8e95dc8040 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:05.598 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:05.598 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:05.598 7f8e95dc8040 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:54:05.598 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:09.598 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:09.599 7f8e95dc8040 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:09.600 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:09.600 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:09.600 7f8e95dc8040 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:09.600 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:09.600 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:09.600 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:09.600 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:09.600 7f8e95dc8040 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:09.600 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:09.600 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:09.601 7f8e95dc8040 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:54:09.601 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:13.604 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:13.605 7f8e95dc8040 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:13.605 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:13.605 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:13.605 7f8e95dc8040 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:13.605 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:13.605 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:13.606 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:13.606 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:13.606 7f8e95dc8040 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:13.606 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:13.606 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:13.606 7f8e95dc8040 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:54:13.606 7f8e95dc8040 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:17.607 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:17.608 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:17.608 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:17.608 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:17.608 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:17.608 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:17.608 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:17.609 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:17.609 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:17.609 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:17.609 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:17.609 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:17.609 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:54:17.609 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:21.479 7f8e95dc8b80 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:54:21.609 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:21.610 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:21.610 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:21.610 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:21.610 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:21.610 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:21.611 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:21.611 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:21.611 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:21.611 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:21.611 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:21.611 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:21.611 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:54:21.611 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:25.615 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:25.616 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:25.616 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:25.616 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:25.616 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:25.616 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:25.616 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:25.616 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:25.616 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:25.617 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:25.617 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:25.617 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:25.617 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:54:25.617 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:29.616 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:29.617 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:29.618 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:29.618 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:29.618 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:29.618 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:29.618 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:29.618 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:29.618 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:29.618 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:29.618 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:29.618 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:29.619 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:54:29.619 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:32.905 7f8e98c66b00 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3994-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19660340, partition_space_available_1k=61430144, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=180672, cpu_share=0.0, mem_res=179216, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=47260, cpu_share=0.01, mem_res=45120, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9366440, free=19873724, buffers=691492, cached=2733464, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.39, five_min_avg=2.05, fifteen_min_avg=1.47, cpu_share=1.12, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 01:54:32.906 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:32.906 7f8e95dc8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 19660340 partition_space_available_1k = 61430144 percentage_partition_space_used = 24 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 180672 cpu_share = 0.0 mem_res = 179216 >>contrail-analytics-nodemgr : << mem_virt = 47260 cpu_share = 0.01 mem_res = 45120 >> } system_mem_usage = << total = 32665120 used = 9366440 free = 19873724 buffers = 691492 cached = 2733464 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 1.39 five_min_avg = 2.05 fifteen_min_avg = 1.47 cpu_share = 1.12 node_type = analytics-node >> >> 09/01/2025 01:54:32.906 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:33.532 7f8e95dc8c20 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:54:33.618 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:33.619 7f8e95dc8c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:33.619 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:33.619 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:33.620 7f8e95dc8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:33.620 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:33.620 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:33.620 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:33.620 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:33.620 7f8e95dc8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:33.620 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:33.620 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:33.620 7f8e95dc8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:54:33.620 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:37.623 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:37.624 7f8e95dc8c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:37.624 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:37.624 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:37.624 7f8e95dc8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:37.624 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:37.624 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:37.625 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:37.625 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:37.625 7f8e95dc8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:37.625 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:37.625 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:37.625 7f8e95dc8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:54:37.625 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:41.628 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:41.629 7f8e95dc8c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:41.629 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:41.629 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:41.629 7f8e95dc8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:41.629 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:41.629 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:41.630 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:41.630 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:41.630 7f8e95dc8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:41.630 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:41.630 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:41.630 7f8e95dc8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:54:41.630 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:45.523 7f8e95dc8c20 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:54:45.630 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:45.631 7f8e95dc8c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:45.631 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:45.631 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:45.631 7f8e95dc8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:45.631 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:45.631 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:45.632 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:45.632 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:45.632 7f8e95dc8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:45.632 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:45.632 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:45.632 7f8e95dc8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:54:45.632 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:49.635 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:49.636 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:49.636 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:49.636 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:49.636 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:49.636 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:49.636 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:49.637 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:49.637 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:49.637 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:49.637 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:49.637 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:49.637 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:54:49.637 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:53.640 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:53.641 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:53.641 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:53.641 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:53.641 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:53.641 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:53.641 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:53.642 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:53.642 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:53.642 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:53.642 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:53.642 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:53.642 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:54:53.642 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:57.582 7f8e95dc8b80 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:54:57.641 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:54:57.643 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:54:57.643 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:54:57.643 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:57.643 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:54:57.643 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:54:57.643 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:54:57.644 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:54:57.644 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:57.644 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:54:57.644 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:57.644 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:54:57.644 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:54:57.644 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:01.644 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:01.645 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:01.645 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:01.645 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:01.645 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:01.645 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:01.645 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:01.646 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:01.646 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:01.646 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:01.646 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:01.646 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:01.646 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:55:01.646 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:05.650 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:05.651 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:05.651 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:05.651 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:05.651 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:05.651 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:05.651 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:05.651 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:05.651 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:05.652 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:05.652 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:05.652 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:05.652 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:55:05.652 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:09.654 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:09.655 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:09.655 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:09.655 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:09.655 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:09.655 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:09.655 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:09.655 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:09.656 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:09.656 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:09.656 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:09.656 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:09.656 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:55:09.656 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:09.657 7f8e95dc8b80 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:55:13.660 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:13.661 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:13.661 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:13.661 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:13.661 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:13.661 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:13.661 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:13.661 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:13.661 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:13.662 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:13.662 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:13.662 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:13.662 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:55:13.662 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:17.661 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:17.663 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:17.663 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:17.663 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:17.663 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:17.663 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:17.663 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:17.663 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:17.663 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:17.663 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:17.663 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:17.664 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:17.664 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:55:17.664 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:21.664 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:21.665 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:21.665 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:21.665 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:21.665 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:21.665 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:21.665 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:21.666 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:21.666 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:21.666 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:21.666 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:21.666 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:21.666 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:55:21.666 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:21.979 7f8e95dcf900 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:55:25.668 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:25.669 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:25.669 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:25.669 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:25.669 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:25.669 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:25.669 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:25.670 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:25.670 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:25.670 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:25.670 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:25.670 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:25.670 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:55:25.670 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:29.673 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:29.674 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:29.674 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:29.675 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:29.675 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:29.675 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:29.675 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:29.675 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:29.675 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:29.675 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:29.675 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:29.675 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:29.675 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:55:29.675 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:32.867 7f8e98c66b00 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3994-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19663528, partition_space_available_1k=61426956, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=180744, cpu_share=0.0, mem_res=179216, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=47308, cpu_share=0.01, mem_res=45120, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9345184, free=19887136, buffers=691540, cached=2741260, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.97, five_min_avg=1.79, fifteen_min_avg=1.42, cpu_share=0.88, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 01:55:32.868 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:32.868 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 19663528 partition_space_available_1k = 61426956 percentage_partition_space_used = 24 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 180744 cpu_share = 0.0 mem_res = 179216 >>contrail-analytics-nodemgr : << mem_virt = 47308 cpu_share = 0.01 mem_res = 45120 >> } system_mem_usage = << total = 32665120 used = 9345184 free = 19887136 buffers = 691540 cached = 2741260 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 0.97 five_min_avg = 1.79 fifteen_min_avg = 1.42 cpu_share = 0.88 node_type = analytics-node >> >> 09/01/2025 01:55:32.868 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:33.675 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:33.677 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:33.677 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:33.677 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:33.677 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:33.677 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:33.677 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:33.677 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:33.678 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:33.678 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:33.678 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:33.678 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:33.678 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:55:33.678 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:34.011 7f8e95dcf900 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:55:37.682 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:37.683 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:37.683 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:37.683 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:37.683 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:37.684 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:37.684 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:37.684 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:37.684 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:37.684 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:37.684 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:37.685 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:37.685 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:55:37.685 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:41.684 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:41.685 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:41.685 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:41.685 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:41.685 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:41.685 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:41.685 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:41.686 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:41.686 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:41.686 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:41.686 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:41.686 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:41.686 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:55:41.686 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:45.688 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:45.689 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:45.689 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:45.689 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:45.689 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:45.689 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:45.689 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:45.690 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:45.690 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:45.690 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:45.690 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:45.690 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:45.690 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:55:45.690 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:45.990 7f8e95dcf900 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:55:49.692 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:49.693 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:49.693 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:49.693 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:49.693 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:49.693 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:49.694 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:49.694 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:49.694 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:49.694 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:49.694 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:49.694 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:49.694 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:55:49.694 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:53.697 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:53.698 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:53.698 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:53.699 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:53.699 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:53.699 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:53.699 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:53.699 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:53.699 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:53.699 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:53.699 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:53.699 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:53.699 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:55:53.700 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:57.700 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:55:57.701 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:55:57.701 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:55:57.701 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:57.701 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:55:57.701 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:55:57.701 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:55:57.702 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:55:57.702 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:57.702 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:55:57.702 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:57.702 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:57.702 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:55:57.702 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:55:58.057 7f8e95dcf900 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:56:01.706 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:01.707 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:01.707 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:01.707 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:01.707 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:01.707 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:01.707 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:01.707 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:01.708 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:01.708 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:01.708 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:01.708 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:01.708 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:56:01.708 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:05.709 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:05.710 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:05.710 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:05.710 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:05.710 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:05.711 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:05.711 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:05.711 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:05.711 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:05.711 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:05.711 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:05.711 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:05.711 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:56:05.711 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:09.715 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:09.716 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:09.716 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:09.716 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:09.716 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:09.716 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:09.716 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:09.717 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:09.717 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:09.717 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:09.717 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:09.717 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:09.717 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:56:09.717 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:10.135 7f8e95dc8ea0 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:56:13.720 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:13.722 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:13.722 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:13.722 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:13.722 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:13.722 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:13.722 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:13.722 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:13.722 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:13.722 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:13.722 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:13.723 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:13.723 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:56:13.723 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:17.722 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:17.724 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:17.724 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:17.724 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:17.724 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:17.724 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:17.724 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:17.724 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:17.724 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:17.725 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:17.725 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:17.725 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:17.725 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:56:17.725 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:21.728 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:21.729 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:21.729 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:21.729 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:21.730 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:21.730 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:21.730 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:21.730 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:21.730 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:21.730 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:21.730 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:21.730 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:21.730 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:56:21.730 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:22.486 7f8e95dcfc20 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:56:25.733 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:25.735 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:25.735 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:25.735 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:25.735 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:25.735 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:25.736 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:25.736 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:25.736 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:25.736 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:25.736 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:25.736 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:25.737 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:56:25.737 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:29.736 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:29.737 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:29.738 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:29.738 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:29.738 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:29.738 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:29.738 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:29.738 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:29.738 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:29.738 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:29.738 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:29.738 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:29.739 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:56:29.739 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:32.873 7f8e98c66b00 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3994-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19666784, partition_space_available_1k=61423700, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=180804, cpu_share=0.0, mem_res=179216, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=47388, cpu_share=0.01, mem_res=45120, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9364564, free=19857552, buffers=691592, cached=2751412, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.37, five_min_avg=1.74, fifteen_min_avg=1.43, cpu_share=0.88, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 01:56:32.874 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:32.874 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 19666784 partition_space_available_1k = 61423700 percentage_partition_space_used = 24 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 180804 cpu_share = 0.0 mem_res = 179216 >>contrail-analytics-nodemgr : << mem_virt = 47388 cpu_share = 0.01 mem_res = 45120 >> } system_mem_usage = << total = 32665120 used = 9364564 free = 19857552 buffers = 691592 cached = 2751412 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 1.37 five_min_avg = 1.74 fifteen_min_avg = 1.43 cpu_share = 0.88 node_type = analytics-node >> >> 09/01/2025 01:56:32.874 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:33.739 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:33.741 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:33.741 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:33.741 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:33.741 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:33.741 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:33.741 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:33.742 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:33.742 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:33.742 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:33.742 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:33.742 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:33.742 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:56:33.742 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:34.508 7f8e95dc8ea0 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:56:37.741 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:37.742 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:37.742 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:37.742 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:37.743 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:37.743 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:37.743 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:37.743 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:37.743 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:37.743 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:37.743 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:37.743 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:37.743 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:56:37.743 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:41.744 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:41.745 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:41.745 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:41.745 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:41.745 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:41.745 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:41.745 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:41.746 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:41.746 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:41.746 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:41.746 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:41.746 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:41.746 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:56:41.746 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:45.749 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:45.750 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:45.750 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:45.750 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:45.750 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:45.750 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:45.750 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:45.751 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:45.751 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:45.751 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:45.751 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:45.751 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:45.751 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:56:45.751 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:46.490 7f8e95dc8ea0 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:56:49.750 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:49.752 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:49.752 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:49.752 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:49.752 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:49.752 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:49.752 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:49.752 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:49.752 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:49.752 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:49.752 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:49.753 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:49.753 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:56:49.753 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:53.756 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:53.757 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:53.757 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:53.757 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:53.757 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:53.757 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:53.758 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:53.758 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:53.758 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:53.758 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:53.758 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:53.758 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:53.758 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:56:53.758 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:57.760 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:57.761 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:57.761 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:57.761 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:57.761 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:57.761 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:57.761 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:57.761 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:57.762 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:57.762 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:57.762 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:57.762 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:57.762 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:56:57.762 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:58.548 7f8e95dc8ea0 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:57:01.764 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:01.765 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:01.766 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:01.766 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:01.766 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:01.766 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:01.766 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:01.766 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:01.766 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:01.766 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:01.766 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:01.766 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:01.767 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:01.767 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:05.769 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:05.770 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:05.770 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:05.770 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:05.770 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:05.770 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:05.770 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:05.771 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:05.771 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:05.771 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:05.771 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:05.771 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:05.771 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:05.771 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:09.775 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:09.776 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:09.776 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:09.776 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:09.776 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:09.776 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:09.776 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:09.777 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:09.777 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:09.777 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:09.777 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:09.777 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:09.777 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:09.777 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:10.590 7f8e9606bd60 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:57:13.779 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:13.781 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:13.781 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:13.781 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:13.781 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:13.781 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:13.781 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:13.781 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:13.781 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:13.782 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:13.782 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:13.782 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:13.782 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:13.782 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:17.785 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:17.786 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:17.786 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:17.786 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:17.786 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:17.786 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:17.787 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:17.787 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:17.787 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:17.787 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:17.787 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:17.787 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:17.787 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:17.787 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:21.788 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:21.789 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:21.789 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:21.789 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:21.789 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:21.789 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:21.789 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:21.789 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:21.790 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:21.790 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:21.790 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:21.790 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:21.790 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:21.790 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:22.940 7f8e95dcf900 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:57:25.792 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:25.793 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:25.793 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:25.793 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:25.794 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:25.794 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:25.794 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:25.794 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:25.794 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:25.794 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:25.794 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:25.794 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:25.794 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:25.794 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:29.794 7f8e95dc84a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:29.795 7f8e95dc84a0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:29.795 7f8e95dc84a0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:29.795 7f8e95dc84a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:29.795 7f8e95dc84a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:29.795 7f8e95dc84a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:29.795 7f8e95dc84a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:29.796 7f8e95dc84a0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:29.796 7f8e95dc84a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:29.796 7f8e95dc84a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:29.796 7f8e95dc84a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:29.796 7f8e95dc84a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:29.796 7f8e95dc84a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:29.796 7f8e95dc84a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:32.880 7f8e98c66b00 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3994-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19670224, partition_space_available_1k=61420260, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=180868, cpu_share=0.0, mem_res=179216, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=47440, cpu_share=0.01, mem_res=45120, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9351308, free=19873888, buffers=691668, cached=2748256, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.79, five_min_avg=1.5, fifteen_min_avg=1.36, cpu_share=0.88, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 01:57:32.880 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:32.880 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 19670224 partition_space_available_1k = 61420260 percentage_partition_space_used = 24 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 180868 cpu_share = 0.0 mem_res = 179216 >>contrail-analytics-nodemgr : << mem_virt = 47440 cpu_share = 0.01 mem_res = 45120 >> } system_mem_usage = << total = 32665120 used = 9351308 free = 19873888 buffers = 691668 cached = 2748256 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 0.79 five_min_avg = 1.5 fifteen_min_avg = 1.36 cpu_share = 0.88 node_type = analytics-node >> >> 09/01/2025 01:57:32.880 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:33.796 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:33.797 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:33.797 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:33.797 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:33.797 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:33.797 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:33.797 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:33.797 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:33.798 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:33.798 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:33.798 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:33.798 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:33.798 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:33.798 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:35.034 7f8e9606bd60 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:57:37.800 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:37.801 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:37.801 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:37.801 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:37.801 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:37.801 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:37.801 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:37.801 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:37.802 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:37.802 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:37.802 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:37.802 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:37.802 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:37.802 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:41.804 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:41.805 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:41.805 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:41.805 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:41.805 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:41.805 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:41.805 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:41.806 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:41.806 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:41.806 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:41.806 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:41.806 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:41.806 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:41.806 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:45.809 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:45.811 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:45.811 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:45.811 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:45.811 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:45.811 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:45.811 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:45.811 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:45.811 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:45.811 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:45.812 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:45.812 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:45.812 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:45.813 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:47.090 7f8e9606bd60 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:57:49.813 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:49.814 7f8e95dc8400 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:49.814 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:49.814 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:49.814 7f8e95dc8400 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:49.814 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:49.814 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:49.814 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:49.815 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:49.815 7f8e95dc8400 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:49.815 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:49.815 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:49.815 7f8e95dc8400 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:49.815 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:53.816 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:53.817 7f8e95dc8400 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:53.817 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:53.817 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:53.817 7f8e95dc8400 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:53.817 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:53.817 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:53.818 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:53.818 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:53.818 7f8e95dc8400 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:53.818 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:53.818 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:53.818 7f8e95dc8400 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:53.818 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:57.820 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:57.821 7f8e95dc8400 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:57.821 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:57.822 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:57.822 7f8e95dc8400 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:57.822 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:57.822 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:57.822 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:57.822 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:57.822 7f8e95dc8400 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:57.822 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:57.822 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:57.822 7f8e95dc8400 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:57.822 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:59.038 7f8e95dc8400 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:58:01.824 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:01.825 7f8e95dc8400 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:01.825 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:01.825 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:01.825 7f8e95dc8400 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:01.825 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:01.825 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:01.826 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:01.826 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:01.826 7f8e95dc8400 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:01.826 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:01.826 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:01.826 7f8e95dc8400 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:01.826 7f8e95dc8400 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:05.827 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:05.828 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:05.828 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:05.829 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:05.829 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:05.829 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:05.829 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:05.829 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:05.829 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:05.829 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:05.829 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:05.829 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:05.829 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:05.829 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:09.832 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:09.833 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:09.833 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:09.833 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:09.833 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:09.833 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:09.833 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:09.834 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:09.834 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:09.834 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:09.834 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:09.834 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:09.834 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:09.834 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:11.132 7f8e9606bc20 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:58:13.837 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:13.838 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:13.838 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:13.838 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:13.838 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:13.838 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:13.839 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:13.839 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:13.839 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:13.839 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:13.839 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:13.839 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:13.839 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:13.839 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:17.843 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:17.844 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:17.844 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:17.844 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:17.844 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:17.844 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:17.844 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:17.844 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:17.845 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:17.845 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:17.845 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:17.845 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:17.845 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:17.845 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:21.847 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:21.849 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:21.849 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:21.849 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:21.849 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:21.849 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:21.849 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:21.849 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:21.850 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:21.850 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:21.850 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:21.850 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:21.850 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:21.850 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:23.494 7f8e9606bb80 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:58:25.852 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:25.853 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:25.853 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:25.853 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:25.853 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:25.853 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:25.853 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:25.854 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:25.854 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:25.854 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:25.854 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:25.854 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:25.854 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:25.854 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:29.853 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:29.855 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:29.855 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:29.855 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:29.855 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:29.855 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:29.855 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:29.856 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:29.856 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:29.856 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:29.856 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:29.856 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:29.856 7f8e95dc8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:29.856 7f8e95dc8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:32.883 7f8e98c66b00 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3994-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19673536, partition_space_available_1k=61416948, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=180924, cpu_share=0.0, mem_res=179216, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=47492, cpu_share=0.01, mem_res=45120, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9356596, free=19865016, buffers=691728, cached=2751780, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.94, five_min_avg=1.4, fifteen_min_avg=1.33, cpu_share=0.88, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 01:58:32.883 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:32.884 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 19673536 partition_space_available_1k = 61416948 percentage_partition_space_used = 24 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 180924 cpu_share = 0.0 mem_res = 179216 >>contrail-analytics-nodemgr : << mem_virt = 47492 cpu_share = 0.01 mem_res = 45120 >> } system_mem_usage = << total = 32665120 used = 9356596 free = 19865016 buffers = 691728 cached = 2751780 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 0.94 five_min_avg = 1.4 fifteen_min_avg = 1.33 cpu_share = 0.88 node_type = analytics-node >> >> 09/01/2025 01:58:32.884 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:33.855 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:33.856 7f8e95dcfe00 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:33.856 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:33.856 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:33.856 7f8e95dcfe00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:33.857 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:33.857 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:33.857 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:33.857 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:33.857 7f8e95dcfe00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:33.857 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:33.857 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:33.857 7f8e95dcfe00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:33.857 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:35.503 7f8e95dcfe00 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:58:37.859 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:37.860 7f8e95dcfe00 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:37.861 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:37.861 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:37.861 7f8e95dcfe00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:37.861 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:37.861 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:37.861 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:37.861 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:37.861 7f8e95dcfe00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:37.861 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:37.861 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:37.862 7f8e95dcfe00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:37.862 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:41.864 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:41.865 7f8e95dcfe00 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:41.865 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:41.865 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:41.865 7f8e95dcfe00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:41.865 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:41.865 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:41.866 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:41.866 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:41.866 7f8e95dcfe00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:41.866 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:41.866 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:41.866 7f8e95dcfe00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:41.866 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:45.868 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:45.869 7f8e95dcfe00 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:45.869 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:45.869 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:45.869 7f8e95dcfe00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:45.869 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:45.869 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:45.870 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:45.870 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:45.870 7f8e95dcfe00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:45.870 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:45.870 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:45.870 7f8e95dcfe00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:45.870 7f8e95dcfe00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:47.511 7f8e95dcfe00 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:58:49.870 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:49.871 7f8e95dc8ae0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:49.871 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:49.871 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:49.872 7f8e95dc8ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:49.872 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:49.872 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:49.872 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:49.872 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:49.872 7f8e95dc8ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:49.872 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:49.872 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:49.873 7f8e95dc8ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:49.873 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:53.876 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:53.877 7f8e95dc8ae0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:53.877 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:53.877 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:53.877 7f8e95dc8ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:53.877 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:53.877 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:53.878 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:53.878 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:53.878 7f8e95dc8ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:53.878 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:53.878 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:53.878 7f8e95dc8ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:53.878 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:57.880 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:57.881 7f8e95dc8ae0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:57.881 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:57.881 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:57.881 7f8e95dc8ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:57.881 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:57.881 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:57.882 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:57.882 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:57.882 7f8e95dc8ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:57.882 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:57.882 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:57.882 7f8e95dc8ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:57.882 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:59.576 7f8e95dc8ae0 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:59:01.883 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:01.884 7f8e95dc8ae0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:01.884 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:01.885 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:01.885 7f8e95dc8ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:01.885 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:01.885 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:01.885 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:01.885 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:01.885 7f8e95dc8ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:01.885 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:01.885 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:01.885 7f8e95dc8ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:01.885 7f8e95dc8ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:05.887 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:05.888 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:05.888 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:05.889 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:05.889 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:05.889 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:05.889 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:05.889 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:05.889 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:05.889 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:05.889 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:05.889 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:05.889 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:05.889 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:09.892 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:09.893 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:09.893 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:09.893 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:09.893 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:09.893 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:09.893 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:09.894 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:09.894 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:09.894 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:09.894 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:09.894 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:09.894 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:09.894 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:11.572 7f8e9606bc20 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:59:13.896 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:13.897 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:13.897 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:13.898 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:13.898 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:13.898 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:13.898 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:13.898 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:13.898 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:13.898 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:13.898 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:13.898 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:13.898 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:13.898 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:17.899 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:17.900 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:17.900 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:17.900 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:17.900 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:17.900 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:17.900 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:17.901 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:17.901 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:17.901 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:17.901 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:17.901 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:17.901 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:17.901 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:21.903 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:21.904 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:21.905 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:21.905 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:21.905 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:21.905 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:21.905 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:21.905 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:21.905 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:21.905 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:21.906 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:21.906 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:21.906 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:21.906 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:23.916 7f8e9606bc20 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:59:25.907 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:25.908 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:25.908 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:25.908 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:25.909 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:25.909 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:25.909 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:25.909 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:25.909 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:25.909 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:25.909 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:25.909 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:25.910 7f8e9606bc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:25.910 7f8e9606bc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:29.909 7f8e95dc8a40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:29.910 7f8e95dc8a40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:29.910 7f8e95dc8a40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:29.910 7f8e95dc8a40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:29.911 7f8e95dc8a40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:29.911 7f8e95dc8a40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:29.911 7f8e95dc8a40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:29.911 7f8e95dc8a40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:29.911 7f8e95dc8a40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:29.911 7f8e95dc8a40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:29.911 7f8e95dc8a40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:29.911 7f8e95dc8a40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:29.911 7f8e95dc8a40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:29.911 7f8e95dc8a40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:32.898 7f8e98c66b00 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3994-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19677844, partition_space_available_1k=61412640, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=180988, cpu_share=0.0, mem_res=179216, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=47540, cpu_share=0.01, mem_res=45120, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9369888, free=19846504, buffers=691960, cached=2756768, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.68, five_min_avg=1.25, fifteen_min_avg=1.28, cpu_share=0.88, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 01:59:32.898 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:32.899 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 19677844 partition_space_available_1k = 61412640 percentage_partition_space_used = 24 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 180988 cpu_share = 0.0 mem_res = 179216 >>contrail-analytics-nodemgr : << mem_virt = 47540 cpu_share = 0.01 mem_res = 45120 >> } system_mem_usage = << total = 32665120 used = 9369888 free = 19846504 buffers = 691960 cached = 2756768 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 0.68 five_min_avg = 1.25 fifteen_min_avg = 1.28 cpu_share = 0.88 node_type = analytics-node >> >> 09/01/2025 01:59:32.899 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:33.912 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:33.913 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:33.913 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:33.913 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:33.913 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:33.913 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:33.913 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:33.913 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:33.914 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:33.914 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:33.914 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:33.914 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:33.914 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:33.914 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:35.979 7f8e9606bd60 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:59:37.913 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:37.915 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:37.915 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:37.915 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:37.915 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:37.915 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:37.915 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:37.916 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:37.916 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:37.916 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:37.916 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:37.916 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:37.916 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:37.916 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:41.920 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:41.921 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:41.921 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:41.921 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:41.921 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:41.921 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:41.921 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:41.921 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:41.921 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:41.922 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:41.922 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:41.922 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:41.922 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:41.922 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:45.923 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:45.924 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:45.924 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:45.924 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:45.924 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:45.924 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:45.925 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:45.925 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:45.925 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:45.925 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:45.925 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:45.925 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:45.925 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:45.925 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:48.014 7f8e9606bd60 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:59:49.925 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:49.926 7f8e95dc8e00 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:49.926 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:49.926 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:49.927 7f8e95dc8e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:49.927 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:49.927 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:49.927 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:49.927 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:49.927 7f8e95dc8e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:49.927 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:49.927 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:49.927 7f8e95dc8e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:49.927 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:53.931 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:53.932 7f8e95dc8e00 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:53.932 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:53.932 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:53.932 7f8e95dc8e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:53.932 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:53.932 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:53.933 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:53.933 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:53.933 7f8e95dc8e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:53.933 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:53.933 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:53.933 7f8e95dc8e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:53.933 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:57.936 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:57.937 7f8e95dc8e00 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:57.937 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:57.937 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:57.937 7f8e95dc8e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:57.937 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:57.937 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:57.938 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:57.938 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:57.938 7f8e95dc8e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:57.938 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:57.938 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:57.938 7f8e95dc8e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:57.938 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:00.167 7f8e95dc8e00 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:00:01.940 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:01.941 7f8e95dc8e00 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:01.941 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:01.941 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:01.941 7f8e95dc8e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:01.941 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:01.941 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:01.942 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:01.942 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:01.942 7f8e95dc8e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:01.942 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:01.942 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:01.942 7f8e95dc8e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:01.942 7f8e95dc8e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:05.942 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:05.944 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:05.944 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:05.944 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:05.944 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:05.944 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:05.944 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:05.944 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:05.944 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:05.944 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:05.945 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:05.945 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:05.945 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:05.945 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:09.944 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:09.946 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:09.946 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:09.946 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:09.946 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:09.946 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:09.946 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:09.946 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:09.946 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:09.946 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:09.946 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:09.947 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:09.947 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:09.947 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:12.300 7f8e95dcf7c0 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:00:13.948 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:13.949 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:13.949 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:13.949 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:13.949 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:13.949 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:13.949 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:13.950 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:13.950 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:13.950 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:13.950 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:13.950 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:13.950 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:13.950 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:17.952 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:17.953 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:17.953 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:17.953 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:17.953 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:17.953 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:17.953 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:17.953 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:17.953 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:17.953 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:17.954 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:17.954 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:17.954 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:17.954 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:21.955 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:21.956 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:21.956 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:21.956 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:21.956 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:21.957 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:21.957 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:21.957 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:21.957 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:21.957 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:21.957 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:21.957 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:21.957 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:21.957 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:24.781 7f8e9606bb80 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:00:25.958 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:25.959 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:25.960 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:25.960 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:25.960 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:25.960 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:25.960 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:25.960 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:25.960 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:25.960 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:25.960 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:25.960 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:25.961 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:25.961 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:29.960 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:29.961 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:29.962 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:29.962 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:29.962 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:29.962 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:29.962 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:29.962 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:29.962 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:29.962 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:29.962 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:29.962 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:29.963 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:29.963 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:32.892 7f8e98c66b00 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3994-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19681228, partition_space_available_1k=61409256, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=181052, cpu_share=0.0, mem_res=179216, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=47592, cpu_share=0.01, mem_res=45120, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9374632, free=19838216, buffers=692028, cached=2760244, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.6, five_min_avg=1.11, fifteen_min_avg=1.23, cpu_share=0.88, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 02:00:32.893 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:32.893 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 19681228 partition_space_available_1k = 61409256 percentage_partition_space_used = 24 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 181052 cpu_share = 0.0 mem_res = 179216 >>contrail-analytics-nodemgr : << mem_virt = 47592 cpu_share = 0.01 mem_res = 45120 >> } system_mem_usage = << total = 32665120 used = 9374632 free = 19838216 buffers = 692028 cached = 2760244 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 0.6 five_min_avg = 1.11 fifteen_min_avg = 1.23 cpu_share = 0.88 node_type = analytics-node >> >> 09/01/2025 02:00:32.893 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:33.963 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:33.964 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:33.965 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:33.965 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:33.965 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:33.965 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:33.965 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:33.965 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:33.965 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:33.966 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:33.966 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:33.966 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:33.966 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:33.966 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:36.896 7f8e95dcfd60 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:00:37.967 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:37.968 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:37.969 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:37.969 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:37.969 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:37.969 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:37.969 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:37.970 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:37.970 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:37.970 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:37.970 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:37.970 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:37.970 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:37.970 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:41.972 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:41.973 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:41.973 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:41.973 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:41.973 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:41.973 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:41.973 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:41.974 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:41.974 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:41.974 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:41.974 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:41.974 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:41.974 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:41.974 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:45.976 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:45.977 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:45.977 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:45.977 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:45.977 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:45.977 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:45.977 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:45.978 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:45.978 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:45.978 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:45.978 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:45.978 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:45.978 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:45.978 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:48.951 7f8e95dcfd60 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:00:49.977 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:49.979 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:49.979 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:49.979 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:49.979 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:49.979 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:49.979 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:49.980 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:49.980 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:49.980 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:49.980 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:49.980 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:49.980 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:49.980 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:53.980 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:53.981 7f8e95dc8cc0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:53.981 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:53.981 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:53.981 7f8e95dc8cc0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:53.981 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:53.981 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:53.982 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:53.982 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:53.982 7f8e95dc8cc0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:53.982 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:53.982 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:53.982 7f8e95dc8cc0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:53.982 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:57.985 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:57.986 7f8e95dc8cc0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:57.986 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:57.987 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:57.987 7f8e95dc8cc0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:57.987 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:57.987 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:57.987 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:57.987 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:57.987 7f8e95dc8cc0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:57.987 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:57.987 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:57.987 7f8e95dc8cc0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:57.987 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:01.137 7f8e95dc8cc0 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:01:01.988 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:01.989 7f8e95dc8cc0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:01.989 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:01.989 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:01.989 7f8e95dc8cc0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:01.989 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:01.989 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:01.990 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:01.990 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:01.990 7f8e95dc8cc0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:01.990 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:01.990 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:01.990 7f8e95dc8cc0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:01.990 7f8e95dc8cc0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:05.991 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:05.992 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:05.992 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:05.992 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:05.992 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:05.992 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:05.992 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:05.992 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:05.993 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:05.993 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:05.993 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:05.993 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:05.993 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:05.993 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:09.996 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:09.997 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:09.997 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:09.997 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:09.997 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:09.997 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:09.997 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:09.998 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:09.998 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:09.998 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:09.998 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:09.998 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:09.998 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:09.998 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:13.282 7f8e95dc8f40 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:01:13.999 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:14.000 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:14.000 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:14.000 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:14.001 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:14.001 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:14.001 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:14.001 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:14.001 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:14.001 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:14.002 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:14.002 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:14.002 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:14.002 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:18.003 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:18.004 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:18.004 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:18.004 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:18.005 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:18.005 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:18.005 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:18.005 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:18.005 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:18.005 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:18.005 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:18.005 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:18.005 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:18.005 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:22.007 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:22.008 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:22.008 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:22.008 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:22.008 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:22.008 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:22.008 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:22.008 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:22.009 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:22.009 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:22.009 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:22.009 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:22.009 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:22.009 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:25.715 7f8e95dc8f40 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:01:26.008 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:26.009 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:26.009 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:26.009 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:26.010 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:26.010 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:26.010 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:26.010 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:26.010 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:26.010 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:26.010 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:26.010 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:26.010 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:26.010 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:30.010 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:30.011 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:30.012 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:30.012 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:30.012 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:30.012 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:30.012 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:30.012 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:30.012 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:30.012 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:30.013 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:30.013 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:30.013 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:30.013 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:32.891 7f8e98c66b00 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3994-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19684628, partition_space_available_1k=61405856, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=181112, cpu_share=0.0, mem_res=179216, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=47644, cpu_share=0.01, mem_res=45120, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9365056, free=19843736, buffers=692092, cached=2764236, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.48, five_min_avg=0.98, fifteen_min_avg=1.18, cpu_share=0.88, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 02:01:32.891 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:32.891 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 19684628 partition_space_available_1k = 61405856 percentage_partition_space_used = 24 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 181112 cpu_share = 0.0 mem_res = 179216 >>contrail-analytics-nodemgr : << mem_virt = 47644 cpu_share = 0.01 mem_res = 45120 >> } system_mem_usage = << total = 32665120 used = 9365056 free = 19843736 buffers = 692092 cached = 2764236 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 0.48 five_min_avg = 0.98 fifteen_min_avg = 1.18 cpu_share = 0.88 node_type = analytics-node >> >> 09/01/2025 02:01:32.891 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:34.012 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:34.013 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:34.013 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:34.013 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:34.013 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:34.013 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:34.013 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:34.014 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:34.014 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:34.014 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:34.014 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:34.014 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:34.014 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:34.014 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:37.842 7f8e95dcfc20 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:01:38.013 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:38.015 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:38.015 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:38.015 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:38.015 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:38.015 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:38.015 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:38.015 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:38.015 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:38.015 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:38.016 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:38.016 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:38.016 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:38.016 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:42.019 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:42.020 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:42.020 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:42.020 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:42.020 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:42.020 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:42.021 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:42.021 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:42.021 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:42.021 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:42.021 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:42.021 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:42.021 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:42.021 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:46.024 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:46.034 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:46.034 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:46.034 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:46.034 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:46.034 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:46.034 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:46.035 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:46.035 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:46.035 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:46.035 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:46.035 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:46.035 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:46.035 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:49.952 7f8e95dcfc20 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:01:50.035 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:50.036 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:50.037 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:50.037 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:50.037 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:50.037 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:50.037 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:50.037 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:50.037 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:50.038 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:50.038 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:50.038 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:50.038 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:50.038 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:54.038 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:54.039 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:54.039 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:54.039 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:54.039 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:54.039 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:54.039 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:54.040 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:54.040 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:54.040 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:54.040 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:54.040 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:54.040 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:54.040 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:58.040 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:58.041 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:58.041 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:58.041 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:58.041 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:58.041 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:58.041 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:58.042 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:58.042 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:58.042 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:58.042 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:58.042 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:58.042 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:58.042 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:02.044 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:02.045 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:02.045 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:02.045 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:02.045 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:02.045 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:02.045 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:02.046 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:02.046 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:02.046 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:02.046 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:02.046 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:02.046 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:02.046 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:02.111 7f8e95dcfc20 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:02:06.046 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:06.047 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:06.047 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:06.047 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:06.047 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:06.047 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:06.047 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:06.047 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:06.047 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:06.048 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:06.048 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:06.048 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:06.048 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:06.048 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:10.051 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:10.052 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:10.053 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:10.053 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:10.053 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:10.053 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:10.053 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:10.053 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:10.054 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:10.054 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:10.054 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:10.054 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:10.054 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:10.054 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:14.056 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:14.057 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:14.057 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:14.057 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:14.057 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:14.057 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:14.057 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:14.057 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:14.058 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:14.058 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:14.058 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:14.058 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:14.058 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:14.058 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:14.130 7f8e9606bd60 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:02:18.058 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:18.059 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:18.059 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:18.060 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:18.060 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:18.060 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:18.060 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:18.060 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:18.060 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:18.060 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:18.060 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:18.060 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:18.060 7f8e9606bd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:18.061 7f8e9606bd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:22.061 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:22.062 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:22.063 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:22.063 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:22.063 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:22.063 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:22.063 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:22.063 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:22.063 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:22.063 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:22.063 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:22.063 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:22.064 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:22.064 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:26.067 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:26.068 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:26.069 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:26.069 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:26.069 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:26.069 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:26.069 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:26.069 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:26.069 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:26.070 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:26.070 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:26.070 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:26.070 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:26.070 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:26.606 7f8e9606bb80 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:02:30.069 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:30.071 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:30.071 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:30.071 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:30.071 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:30.071 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:30.071 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:30.072 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:30.072 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:30.072 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:30.072 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:30.072 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:30.072 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:30.072 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:32.897 7f8e98c66b00 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3994-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19688140, partition_space_available_1k=61402344, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=181176, cpu_share=0.0, mem_res=179216, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=47696, cpu_share=0.01, mem_res=45120, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9388816, free=19816236, buffers=692144, cached=2767924, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.31, five_min_avg=0.85, fifteen_min_avg=1.12, cpu_share=0.88, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 02:02:32.898 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:32.898 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 19688140 partition_space_available_1k = 61402344 percentage_partition_space_used = 24 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 181176 cpu_share = 0.0 mem_res = 179216 >>contrail-analytics-nodemgr : << mem_virt = 47696 cpu_share = 0.01 mem_res = 45120 >> } system_mem_usage = << total = 32665120 used = 9388816 free = 19816236 buffers = 692144 cached = 2767924 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 0.31 five_min_avg = 0.85 fifteen_min_avg = 1.12 cpu_share = 0.88 node_type = analytics-node >> >> 09/01/2025 02:02:32.898 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:34.072 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:34.073 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:34.073 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:34.073 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:34.073 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:34.073 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:34.073 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:34.074 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:34.074 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:34.074 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:34.074 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:34.074 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:34.074 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:34.074 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:38.075 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:38.076 7f8e95dcf5e0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:38.076 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:38.076 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:38.077 7f8e95dcf5e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:38.077 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:38.077 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:38.077 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:38.077 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:38.077 7f8e95dcf5e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:38.077 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:38.077 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:38.077 7f8e95dcf5e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:38.077 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:38.718 7f8e95dcf5e0 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:02:42.080 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:42.081 7f8e95dcf5e0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:42.081 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:42.081 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:42.081 7f8e95dcf5e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:42.081 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:42.081 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:42.082 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:42.082 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:42.082 7f8e95dcf5e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:42.082 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:42.082 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:42.082 7f8e95dcf5e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:42.082 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:46.084 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:46.085 7f8e95dcf5e0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:46.085 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:46.085 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:46.085 7f8e95dcf5e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:46.085 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:46.085 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:46.086 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:46.086 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:46.086 7f8e95dcf5e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:46.086 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:46.086 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:46.086 7f8e95dcf5e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:46.086 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:50.088 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:50.089 7f8e95dcf5e0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:50.089 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:50.089 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:50.089 7f8e95dcf5e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:50.089 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:50.089 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:50.090 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:50.090 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:50.090 7f8e95dcf5e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:50.090 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:50.090 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:50.090 7f8e95dcf5e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:50.090 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:50.739 7f8e95dcf5e0 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:02:54.092 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:54.093 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:54.093 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:54.093 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:54.093 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:54.093 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:54.093 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:54.094 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:54.094 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:54.094 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:54.094 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:54.094 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:54.094 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:54.094 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:58.094 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:58.095 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:58.095 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:58.095 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:58.095 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:58.095 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:58.095 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:58.095 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:58.095 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:58.096 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:58.096 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:58.096 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:58.096 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:58.096 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:02.099 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:02.100 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:02.100 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:02.100 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:02.101 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:02.101 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:02.101 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:02.101 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:02.101 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:02.101 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:02.101 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:02.101 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:02.101 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:02.101 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:02.770 7f8e95dcfd60 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:03:06.104 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:06.105 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:06.105 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:06.105 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:06.106 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:06.106 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:06.106 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:06.106 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:06.106 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:06.106 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:06.106 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:06.106 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:06.106 7f8e95dcfd60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:06.106 7f8e95dcfd60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:10.110 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:10.111 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:10.111 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:10.111 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:10.111 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:10.111 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:10.111 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:10.112 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:10.112 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:10.112 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:10.112 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:10.112 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:10.112 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:10.112 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:14.115 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:14.117 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:14.117 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:14.117 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:14.117 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:14.117 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:14.117 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:14.117 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:14.117 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:14.117 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:14.117 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:14.118 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:14.118 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:14.118 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:14.891 7f8e9606bb80 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:03:18.120 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:18.121 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:18.121 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:18.121 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:18.121 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:18.121 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:18.121 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:18.122 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:18.122 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:18.122 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:18.122 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:18.122 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:18.122 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:18.122 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:22.122 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:22.123 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:22.124 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:22.124 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:22.124 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:22.124 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:22.124 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:22.124 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:22.124 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:22.124 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:22.125 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:22.125 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:22.125 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:22.125 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:26.128 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:26.129 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:26.129 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:26.129 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:26.129 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:26.129 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:26.129 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:26.130 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:26.130 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:26.130 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:26.130 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:26.130 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:26.130 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:26.130 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:27.405 7f8e95dcf7c0 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:03:30.130 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:30.132 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:30.132 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:30.132 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:30.132 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:30.132 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:30.132 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:30.133 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:30.133 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:30.133 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:30.133 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:30.133 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:30.133 7f8e95dc8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:30.133 7f8e95dc8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:32.895 7f8e98c66b00 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3994-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19691468, partition_space_available_1k=61399016, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=181236, cpu_share=0.0, mem_res=179216, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=47744, cpu_share=0.01, mem_res=45120, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9402248, free=19799272, buffers=692168, cached=2771432, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.43, five_min_avg=0.8, fifteen_min_avg=1.08, cpu_share=0.88, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 02:03:32.896 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:32.896 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 19691468 partition_space_available_1k = 61399016 percentage_partition_space_used = 24 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 181236 cpu_share = 0.0 mem_res = 179216 >>contrail-analytics-nodemgr : << mem_virt = 47744 cpu_share = 0.01 mem_res = 45120 >> } system_mem_usage = << total = 32665120 used = 9402248 free = 19799272 buffers = 692168 cached = 2771432 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 0.43 five_min_avg = 0.8 fifteen_min_avg = 1.08 cpu_share = 0.88 node_type = analytics-node >> >> 09/01/2025 02:03:32.896 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:34.132 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:34.133 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:34.134 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:34.134 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:34.134 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:34.134 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:34.134 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:34.134 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:34.134 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:34.135 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:34.135 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:34.135 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:34.135 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:34.135 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:38.136 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:38.176 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:38.177 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:38.177 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:38.177 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:38.177 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:38.177 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:38.177 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:38.177 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:38.177 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:38.178 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:38.178 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:38.178 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:38.178 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:39.553 7f8e95dcf7c0 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:03:42.180 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:42.181 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:42.182 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:42.182 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:42.182 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:42.182 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:42.182 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:42.182 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:42.182 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:42.183 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:42.183 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:42.183 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:42.183 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:42.183 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:46.183 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:46.184 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:46.184 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:46.184 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:46.184 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:46.184 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:46.184 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:46.184 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:46.185 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:46.185 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:46.185 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:46.185 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:46.185 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:46.185 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:50.188 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:50.189 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:50.189 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:50.189 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:50.189 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:50.189 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:50.189 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:50.190 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:50.190 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:50.190 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:50.190 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:50.190 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:50.190 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:50.190 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:51.650 7f8e95dc8d60 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:03:54.192 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:54.193 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:54.194 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:54.194 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:54.194 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:54.194 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:54.194 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:54.194 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:54.194 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:54.194 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:54.194 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:54.194 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:54.195 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:54.195 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:58.195 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:58.196 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:58.197 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:58.197 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:58.197 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:58.197 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:58.197 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:58.197 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:58.197 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:58.197 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:58.197 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:58.197 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:58.197 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:58.198 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:02.200 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:02.201 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:02.201 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:02.201 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:02.201 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:02.201 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:02.201 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:02.202 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:02.202 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:02.202 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:02.202 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:02.202 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:02.202 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:02.202 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:03.785 7f8e9606bb80 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:04:06.203 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:06.204 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:06.204 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:06.204 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:06.204 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:06.204 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:06.205 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:06.205 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:06.205 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:06.205 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:06.205 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:06.205 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:06.205 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:06.205 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:10.208 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:10.209 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:10.209 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:10.209 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:10.209 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:10.209 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:10.209 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:10.210 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:10.210 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:10.210 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:10.210 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:10.210 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:10.210 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:10.210 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:14.212 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:14.213 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:14.213 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:14.213 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:14.213 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:14.213 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:14.213 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:14.214 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:14.214 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:14.214 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:14.214 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:14.214 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:14.214 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:14.214 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:15.878 7f8e95dcf7c0 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:04:18.216 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:18.217 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:18.217 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:18.217 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:18.217 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:18.217 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:18.217 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:18.218 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:18.218 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:18.218 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:18.218 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:18.218 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:18.218 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:18.218 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:22.217 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:22.218 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:22.218 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:22.218 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:22.219 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:22.219 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:22.219 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:22.219 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:22.219 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:22.219 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:22.219 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:22.219 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:22.219 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:22.219 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:26.223 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:26.224 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:26.224 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:26.224 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:26.224 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:26.224 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:26.224 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:26.225 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:26.225 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:26.225 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:26.225 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:26.225 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:26.225 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:26.225 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:28.323 7f8e9606bb80 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:04:30.225 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:30.227 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:30.227 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:30.227 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:30.227 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:30.227 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:30.227 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:30.228 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:30.228 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:30.228 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:30.228 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:30.228 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:30.228 7f8e95dc8540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:30.228 7f8e95dc8540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:32.909 7f8e98c66b00 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3994-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19695368, partition_space_available_1k=61395116, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=181304, cpu_share=0.0, mem_res=179216, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=47792, cpu_share=0.01, mem_res=45120, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9397760, free=19799068, buffers=692248, cached=2776044, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.59, five_min_avg=0.76, fifteen_min_avg=1.05, cpu_share=0.88, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 02:04:32.910 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:32.910 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 19695368 partition_space_available_1k = 61395116 percentage_partition_space_used = 24 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 181304 cpu_share = 0.0 mem_res = 179216 >>contrail-analytics-nodemgr : << mem_virt = 47792 cpu_share = 0.01 mem_res = 45120 >> } system_mem_usage = << total = 32665120 used = 9397760 free = 19799068 buffers = 692248 cached = 2776044 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 0.59 five_min_avg = 0.76 fifteen_min_avg = 1.05 cpu_share = 0.88 node_type = analytics-node >> >> 09/01/2025 02:04:32.910 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:34.228 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:34.229 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:34.229 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:34.229 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:34.229 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:34.229 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:34.229 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:34.230 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:34.230 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:34.230 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:34.230 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:34.230 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:34.230 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:34.230 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:38.231 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:38.232 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:38.232 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:38.232 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:38.232 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:38.232 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:38.232 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:38.233 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:38.233 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:38.233 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:38.233 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:38.233 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:38.233 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:38.233 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:40.458 7f8e95dcf7c0 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:04:42.234 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:42.235 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:42.235 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:42.236 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:42.236 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:42.236 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:42.236 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:42.236 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:42.236 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:42.236 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:42.236 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:42.236 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:42.236 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:42.236 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:46.238 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:46.239 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:46.239 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:46.240 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:46.240 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:46.240 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:46.240 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:46.240 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:46.240 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:46.240 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:46.240 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:46.240 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:46.240 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:46.240 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:50.240 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:50.241 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:50.241 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:50.241 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:50.241 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:50.241 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:50.241 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:50.242 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:50.242 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:50.242 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:50.242 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:50.242 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:50.242 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:50.242 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:52.581 7f8e9606bb80 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:04:54.243 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:54.244 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:54.244 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:54.244 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:54.244 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:54.244 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:54.244 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:54.245 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:54.245 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:54.245 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:54.245 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:54.245 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:54.245 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:54.245 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:58.248 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:58.250 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:58.250 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:58.250 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:58.250 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:58.250 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:58.250 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:58.250 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:58.250 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:58.251 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:58.251 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:58.251 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:58.251 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:58.251 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:02.254 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:02.255 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:02.255 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:02.255 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:02.256 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:02.256 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:02.256 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:02.256 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:02.256 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:02.256 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:02.256 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:02.256 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:02.256 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:02.256 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:04.629 7f8e9606bb80 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:05:06.257 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:06.258 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:06.258 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:06.259 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:06.259 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:06.259 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:06.259 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:06.259 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:06.259 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:06.259 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:06.259 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:06.259 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:06.260 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:06.260 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:10.262 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:10.263 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:10.263 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:10.263 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:10.263 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:10.263 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:10.263 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:10.263 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:10.264 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:10.264 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:10.264 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:10.264 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:10.264 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:10.264 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:14.264 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:14.265 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:14.265 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:14.265 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:14.265 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:14.265 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:14.265 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:14.266 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:14.266 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:14.266 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:14.266 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:14.266 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:14.266 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:14.266 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:16.735 7f8e95dcf7c0 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:05:18.267 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:18.268 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:18.268 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:18.268 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:18.269 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:18.269 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:18.269 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:18.269 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:18.269 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:18.269 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:18.269 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:18.269 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:18.269 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:18.269 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:22.273 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:22.274 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:22.274 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:22.274 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:22.274 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:22.274 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:22.274 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:22.274 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:22.275 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:22.275 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:22.275 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:22.275 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:22.275 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:22.275 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:26.277 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:26.278 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:26.278 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:26.278 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:26.278 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:26.278 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:26.278 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:26.279 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:26.279 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:26.279 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:26.279 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:26.279 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:26.279 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:26.279 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:29.156 7f8e9606bb80 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:05:30.279 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:30.280 7f8e95dc8c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:30.280 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:30.280 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:30.280 7f8e95dc8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:30.280 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:30.281 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:30.281 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:30.281 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:30.281 7f8e95dc8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:30.281 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:30.281 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:30.281 7f8e95dc8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:30.281 7f8e95dc8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:32.899 7f8e98c66b00 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3994-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19698740, partition_space_available_1k=61391744, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=181364, cpu_share=0.0, mem_res=179216, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=47844, cpu_share=0.01, mem_res=45120, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9395864, free=19797344, buffers=692296, cached=2779616, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.71, five_min_avg=0.76, fifteen_min_avg=1.03, cpu_share=0.88, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 02:05:32.900 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:32.900 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 19698740 partition_space_available_1k = 61391744 percentage_partition_space_used = 24 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 181364 cpu_share = 0.0 mem_res = 179216 >>contrail-analytics-nodemgr : << mem_virt = 47844 cpu_share = 0.01 mem_res = 45120 >> } system_mem_usage = << total = 32665120 used = 9395864 free = 19797344 buffers = 692296 cached = 2779616 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 0.71 five_min_avg = 0.76 fifteen_min_avg = 1.03 cpu_share = 0.88 node_type = analytics-node >> >> 09/01/2025 02:05:32.900 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:34.282 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:34.283 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:34.283 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:34.283 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:34.283 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:34.283 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:34.284 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:34.284 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:34.284 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:34.284 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:34.284 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:34.284 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:34.285 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:34.285 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:38.285 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:38.286 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:38.286 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:38.286 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:38.286 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:38.286 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:38.286 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:38.286 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:38.286 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:38.287 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:38.287 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:38.287 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:38.287 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:38.287 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:41.131 7f8e95dcf7c0 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:05:42.288 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:42.289 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:42.289 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:42.289 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:42.289 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:42.289 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:42.289 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:42.289 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:42.289 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:42.290 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:42.290 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:42.290 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:42.290 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:42.290 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:46.292 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:46.293 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:46.293 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:46.293 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:46.294 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:46.294 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:46.294 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:46.294 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:46.294 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:46.294 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:46.294 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:46.294 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:46.294 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:46.294 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:50.298 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:50.299 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:50.299 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:50.299 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:50.299 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:50.299 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:50.299 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:50.300 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:50.300 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:50.300 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:50.300 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:50.300 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:50.300 7f8e95dcf7c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:50.300 7f8e95dcf7c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:53.209 7f8e9606bb80 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:05:54.301 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:54.302 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:54.302 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:54.302 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:54.302 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:54.302 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:54.302 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:54.303 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:54.303 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:54.303 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:54.303 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:54.303 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:54.303 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:54.303 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:58.306 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:58.307 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:58.308 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:58.308 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:58.308 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:58.308 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:58.308 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:58.308 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:58.308 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:58.309 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:58.309 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:58.309 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:58.309 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:58.309 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:02.312 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:02.313 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:02.313 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:02.313 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:02.313 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:02.313 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:02.313 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:02.314 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:02.314 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:02.314 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:02.314 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:02.314 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:02.314 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:02.314 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:05.379 7f8e9606bb80 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:06:06.315 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:06.316 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:06.316 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:06.316 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:06.316 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:06.316 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:06.316 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:06.317 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:06.317 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:06.317 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:06.317 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:06.317 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:06.317 7f8e9606bb80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:06.317 7f8e9606bb80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:10.319 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:10.320 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:10.320 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:10.320 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:10.320 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:10.320 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:10.320 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:10.321 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:10.321 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:10.321 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:10.321 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:10.321 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:10.321 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:10.321 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:14.321 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:14.323 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:14.323 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:14.323 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:14.323 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:14.323 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:14.323 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:14.323 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:14.323 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:14.324 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:14.324 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:14.324 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:14.324 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:14.324 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:17.464 7f8e95dcf900 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:06:18.324 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:18.325 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:18.325 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:18.325 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:18.325 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:18.325 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:18.325 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:18.326 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:18.326 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:18.326 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:18.326 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:18.326 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:18.326 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:18.326 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:22.328 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:22.329 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:22.329 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:22.329 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:22.329 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:22.329 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:22.329 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:22.330 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:22.330 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:22.330 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:22.330 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:22.330 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:22.330 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:22.330 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:26.332 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:26.333 7f8e95dcf5e0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:26.333 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:26.333 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:26.333 7f8e95dcf5e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:26.333 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:26.333 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:26.334 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:26.334 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:26.334 7f8e95dcf5e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:26.334 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:26.334 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:26.334 7f8e95dcf5e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:26.334 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:29.921 7f8e95dc8ea0 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:06:30.334 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:30.336 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:30.336 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:30.336 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:30.336 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:30.336 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:30.336 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:30.337 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:30.337 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:30.337 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:30.337 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:30.337 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:30.337 7f8e95dc8ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:30.337 7f8e95dc8ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:31.990 7f8e95dc8ea0 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:06:32.910 7f8e98c66b00 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3994-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19706452, partition_space_available_1k=61384032, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=181428, cpu_share=0.0, mem_res=179216, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=47888, cpu_share=0.01, mem_res=45120, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9403712, free=19785624, buffers=692456, cached=2783328, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.74, five_min_avg=0.75, fifteen_min_avg=1.0, cpu_share=1.0, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 02:06:32.910 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:32.910 7f8e95dcf5e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 19706452 partition_space_available_1k = 61384032 percentage_partition_space_used = 24 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 181428 cpu_share = 0.0 mem_res = 179216 >>contrail-analytics-nodemgr : << mem_virt = 47888 cpu_share = 0.01 mem_res = 45120 >> } system_mem_usage = << total = 32665120 used = 9403712 free = 19785624 buffers = 692456 cached = 2783328 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 0.74 five_min_avg = 0.75 fifteen_min_avg = 1.0 cpu_share = 1.0 node_type = analytics-node >> >> 09/01/2025 02:06:32.910 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:34.092 7f8e95dcf5e0 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:06:34.337 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:34.338 7f8e95dcf5e0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:34.338 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:34.338 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:34.338 7f8e95dcf5e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:34.338 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:34.338 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:34.338 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:34.339 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:34.339 7f8e95dcf5e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:34.339 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:34.339 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:34.339 7f8e95dcf5e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:34.339 7f8e95dcf5e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:38.338 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:38.340 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:38.340 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:38.340 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:38.340 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:38.340 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:38.340 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:38.341 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:38.341 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:38.341 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:38.341 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:38.341 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:38.341 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:38.341 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:42.344 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:42.345 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:42.345 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:42.345 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:42.345 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:42.345 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:42.345 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:42.346 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:42.346 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:42.346 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:42.346 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:42.346 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:42.346 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:42.346 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:46.348 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:46.349 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:46.349 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:46.349 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:46.349 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:46.349 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:46.349 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:46.350 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:46.350 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:46.350 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:46.350 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:46.350 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:46.350 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:46.350 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:50.353 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:50.354 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:50.354 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:50.354 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:50.354 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:50.354 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:50.354 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:50.354 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:50.355 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:50.355 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:50.355 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:50.355 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:50.355 7f8e95dcf900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:50.355 7f8e95dcf900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:54.355 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:54.356 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:54.357 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:54.357 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:54.357 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:54.357 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:54.357 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:54.357 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:54.357 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:54.357 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:54.357 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:54.357 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:54.358 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:54.358 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:58.360 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:58.361 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:58.361 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:58.361 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:58.361 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:58.361 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:58.361 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:58.362 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:58.362 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:58.362 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:58.362 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:58.362 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:58.362 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:58.362 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:00.312 7f8e95dcfc20 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:07:02.362 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:02.363 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:02.363 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:02.364 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:02.364 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:02.364 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:02.364 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:02.364 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:02.364 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:02.364 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:02.364 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:02.364 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:02.364 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:02.364 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:06.364 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:06.365 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:06.365 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:06.365 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:06.365 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:06.365 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:06.365 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:06.365 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:06.366 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:06.366 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:06.366 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:06.366 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:06.366 7f8e95dcfc20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3994-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691489442009 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:06.366 7f8e95dcfc20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]