09/01/2025 01:58:52.998 7fdf3fc40ac0 [contrail-analytics-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 09/01/2025 01:58:52.998 7fdf3fc40ac0 [contrail-analytics-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 09/01/2025 01:58:52.998 7fdf3fc40ac0 [contrail-analytics-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 09/01/2025 01:58:53.015 7fdf3d1f44a0 [contrail-analytics-nodemgr] [ERROR]: Cannot write http_port 8104 to /tmp/contrail-analytics-nodemgr.0.http_port 09/01/2025 01:58:53.016 7fdf3d1f44a0 [contrail-analytics-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8104 09/01/2025 01:58:53.017 7fdf3d1f4860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvStart] in state[none] 09/01/2025 01:58:53.022 7fdf3d1f4860 [contrail-analytics-nodemgr] [DEBUG]: Add uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:58:53.022 7fdf3d1f4860 [contrail-analytics-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/01/2025 01:58:53.022 7fdf3d1f4860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 09/01/2025 01:58:53.023 7fdf3d1f4860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:53.023 7fdf3d1f4860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/01/2025 01:58:53.023 7fdf3d1f4860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:53.023 7fdf3d1f4860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:53.023 7fdf3d1f4860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 09/01/2025 01:58:53.023 7fdf3d1f4860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:53.217 7fdf3fc40ac0 [contrail-analytics-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-collector', 'group': 'contrail-collector', 'pid': 51360418140223793918268396603061296510275759025486163210587678937827012696938, 'start': '1756691932000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-analytics-api', 'group': 'contrail-analytics-api', 'pid': 89417993451535370706978252117308404033011910503312712472717999447806494061528, 'start': '1756691930000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-analytics-nodemgr', 'group': 'contrail-analytics-nodemgr', 'pid': 7393755956778605303656721896336996166703647629935985191004591276209766351331, 'start': '1756691930000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 09/01/2025 01:58:53.328 7fdf3fc40ac0 [contrail-analytics-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-3995-1.', _node_type='Analytics', _instance_id='0', _timestamp=1756691933328387, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3995-1.', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-analytics-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo'), _seqnum=0) 09/01/2025 01:58:53.328 7fdf3fc40ac0 [contrail-analytics-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-3995-1.', _node_type='Analytics', _instance_id='0', _timestamp=1756691933328892, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3995-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-collector', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1756691932000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1756691930000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1756691930000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-09-01 00:14:10.876612", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-10717-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed\n"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo'), _seqnum=0) 09/01/2025 01:58:53.331 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:53.332 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. build_info = {"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-09-01 00:14:10.876612", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-10717-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed "}]} system_cpu_info = << num_socket = 1 num_cpu = 4 num_core_per_socket = 4 num_thread_per_core = 1 >> running_package_version = package contrail-lib is not installed installed_package_version = package contrail-lib is not installed >> 09/01/2025 01:58:53.332 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:53.332 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:53.332 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/01/2025 01:58:53.332 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:53.332 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:53.332 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. deleted = False process_info = [ << process_name = contrail-collector process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1756691932000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-analytics-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1756691930000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-analytics-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1756691930000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-09-01 00:14:10.876612", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-10717-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed "}]} >> 09/01/2025 01:58:53.332 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:56.507 7fdf3fc40ac0 [contrail-analytics-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-3995-1.', _node_type='Analytics', _instance_id='0', _timestamp=1756691936507680, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3995-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-collector', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1756691932000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1756691930000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1756691930000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-09-01 00:14:10.876612", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-10717-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed\n"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo'), _seqnum=0) 09/01/2025 01:58:56.508 7fdf3fc40ac0 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3995-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14920972, partition_space_available_1k=66169512, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=0, cpu_share=0.0, mem_res=0, _EventManager__key='contrail-collector'), 'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=2276, cpu_share=0.0, mem_res=1252, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=49132, cpu_share=0.0, mem_res=38220, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=7233680, free=285580, buffers=566108, cached=8090272, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.59, five_min_avg=2.69, fifteen_min_avg=1.62, cpu_share=0, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 01:58:56.508 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:56.508 7fdf3cdb2360 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. deleted = False process_info = [ << process_name = contrail-collector process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1756691932000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-analytics-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1756691930000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-analytics-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1756691930000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-09-01 00:14:10.876612", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-10717-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed "}]} >> 09/01/2025 01:58:56.508 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:56.508 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:56.508 7fdf3cdb2360 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 14920972 partition_space_available_1k = 66169512 percentage_partition_space_used = 18 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-collector : << mem_virt = 0 cpu_share = 0.0 mem_res = 0 >>contrail-analytics-api : << mem_virt = 2276 cpu_share = 0.0 mem_res = 1252 >>contrail-analytics-nodemgr : << mem_virt = 49132 cpu_share = 0.0 mem_res = 38220 >> } system_mem_usage = << total = 16175640 used = 7233680 free = 285580 buffers = 566108 cached = 8090272 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 3.59 five_min_avg = 2.69 fifteen_min_avg = 1.62 cpu_share = 0 node_type = analytics-node >> >> 09/01/2025 01:58:56.508 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:57.022 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:57.024 7fdf3cdb2360 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:57.024 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:57.024 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:57.024 7fdf3cdb2360 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:57.024 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:57.024 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:57.024 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:57.025 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:57.025 7fdf3cdb2360 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:57.025 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:57.025 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:57.025 7fdf3cdb2360 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:57.025 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:01.028 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:01.030 7fdf3cdb2360 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:01.030 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:01.030 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:01.030 7fdf3cdb2360 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:01.030 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:01.030 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:01.030 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:01.030 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:01.031 7fdf3cdb2360 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:01.031 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:01.031 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:01.031 7fdf3cdb2360 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:01.031 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:05.031 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:05.032 7fdf3cdb2360 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:05.032 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:05.032 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:05.032 7fdf3cdb2360 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:05.032 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:05.032 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:05.032 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:05.033 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:05.033 7fdf3cdb2360 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:05.033 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:05.033 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:05.033 7fdf3cdb2360 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:05.033 7fdf3cdb2360 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:08.775 7fdf3cdb29a0 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_process_state:contrail-collector,group:contrail-collector,state:PROCESS_STATE_BACKOFF 09/01/2025 01:59:09.032 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:09.034 7fdf3cdb2a40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:09.034 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:09.034 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:09.034 7fdf3cdb2a40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:09.034 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:09.034 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:09.034 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:09.034 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:09.034 7fdf3cdb2a40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:09.034 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:09.034 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:09.035 7fdf3cdb2a40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:09.035 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:13.039 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:13.040 7fdf3cdb2a40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:13.040 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:13.040 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:13.040 7fdf3cdb2a40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:13.040 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:13.040 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:13.041 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:13.041 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:13.041 7fdf3cdb2a40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:13.041 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:13.041 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:13.041 7fdf3cdb2a40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:13.041 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:17.044 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:17.045 7fdf3cdb2a40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:17.045 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:17.045 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:17.045 7fdf3cdb2a40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:17.045 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:17.045 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:17.046 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:17.046 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:17.046 7fdf3cdb2a40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:17.046 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:17.046 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:17.046 7fdf3cdb2a40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:17.046 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:21.049 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:21.050 7fdf3cdb2a40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:21.050 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:21.050 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:21.050 7fdf3cdb2a40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:21.051 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:21.051 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:21.051 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:21.051 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:21.051 7fdf3cdb2a40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:21.051 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:21.051 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:21.051 7fdf3cdb2a40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:21.051 7fdf3cdb2a40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:25.052 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:25.053 7fdf3cdb27c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:25.054 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:25.054 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:25.054 7fdf3cdb27c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:25.054 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:25.054 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:25.054 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:25.054 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:25.055 7fdf3cdb27c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:25.055 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:25.055 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:25.055 7fdf3cdb27c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:25.055 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:29.058 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:29.059 7fdf3cdb27c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:29.059 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:29.060 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:29.060 7fdf3cdb27c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:29.060 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:29.060 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:29.060 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:29.060 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:29.060 7fdf3cdb27c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:29.061 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:29.061 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:29.061 7fdf3cdb27c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:29.061 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:33.063 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:33.064 7fdf3cdb27c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:33.064 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:33.064 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:33.064 7fdf3cdb27c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:33.064 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:33.064 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:33.065 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:33.065 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:33.065 7fdf3cdb27c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:33.065 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:33.065 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:33.065 7fdf3cdb27c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:33.065 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:37.068 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:37.069 7fdf3cdb27c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:37.069 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:37.069 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:37.070 7fdf3cdb27c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:37.070 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:37.070 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:37.070 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:37.070 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:37.070 7fdf3cdb27c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:37.070 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:37.070 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:37.070 7fdf3cdb27c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:37.070 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:41.071 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:41.072 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:41.072 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:41.073 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:41.073 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:41.073 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:41.073 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:41.073 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:41.073 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:41.073 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:41.073 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:41.073 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:41.073 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:41.073 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:45.075 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:45.076 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:45.077 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:45.077 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:45.077 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:45.077 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:45.077 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:45.077 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:45.077 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:45.078 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:45.078 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:45.078 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:45.078 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:45.078 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:49.081 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:49.082 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:49.083 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:49.083 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:49.083 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:49.083 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:49.083 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:49.083 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:49.083 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:49.083 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:49.083 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:49.083 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:49.083 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:49.084 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:53.083 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:53.084 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:53.084 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:53.084 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:53.084 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:53.084 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:53.084 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:53.085 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:53.085 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:53.085 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:53.085 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:53.085 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:53.085 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:53.085 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:56.356 7fdf3fc40ac0 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3995-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15727232, partition_space_available_1k=65363252, percentage_partition_space_used=19, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=182600, cpu_share=0.05, mem_res=179480, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=48360, cpu_share=0.01, mem_res=38220, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=8405612, free=353384, buffers=581268, cached=6835376, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.34, five_min_avg=2.89, fifteen_min_avg=1.76, cpu_share=10.0, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 01:59:56.356 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:56.356 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 15727232 partition_space_available_1k = 65363252 percentage_partition_space_used = 19 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 182600 cpu_share = 0.05 mem_res = 179480 >>contrail-analytics-nodemgr : << mem_virt = 48360 cpu_share = 0.01 mem_res = 38220 >> } system_mem_usage = << total = 16175640 used = 8405612 free = 353384 buffers = 581268 cached = 6835376 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 3.34 five_min_avg = 2.89 fifteen_min_avg = 1.76 cpu_share = 10.0 node_type = analytics-node >> >> 09/01/2025 01:59:56.356 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:57.085 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:57.087 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:57.087 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:57.087 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:57.087 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:57.087 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:57.087 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:57.088 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:57.088 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:57.088 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:57.088 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:57.088 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:57.088 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:57.088 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:01.091 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:01.092 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:01.092 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:01.092 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:01.092 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:01.092 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:01.092 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:01.093 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:01.093 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:01.093 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:01.093 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:01.093 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:01.093 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:01.093 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:05.095 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:05.096 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:05.096 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:05.096 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:05.096 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:05.096 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:05.096 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:05.097 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:05.097 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:05.097 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:05.097 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:05.097 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:05.097 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:05.097 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:09.100 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:09.101 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:09.101 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:09.101 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:09.102 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:09.102 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:09.102 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:09.102 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:09.102 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:09.102 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:09.102 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:09.102 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:09.102 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:09.102 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:13.102 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:13.103 7fdf3cdb2540 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:13.103 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:13.103 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:13.104 7fdf3cdb2540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:13.104 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:13.104 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:13.104 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:13.104 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:13.104 7fdf3cdb2540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:13.104 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:13.104 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:13.104 7fdf3cdb2540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:13.104 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:17.105 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:17.106 7fdf3cdb2540 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:17.106 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:17.106 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:17.107 7fdf3cdb2540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:17.107 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:17.107 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:17.107 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:17.107 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:17.107 7fdf3cdb2540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:17.107 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:17.107 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:17.108 7fdf3cdb2540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:17.108 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:21.107 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:21.109 7fdf3cdb2540 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:21.109 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:21.109 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:21.109 7fdf3cdb2540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:21.109 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:21.109 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:21.109 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:21.109 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:21.110 7fdf3cdb2540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:21.110 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:21.110 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:21.110 7fdf3cdb2540 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:21.110 7fdf3cdb2540 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:25.110 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:25.111 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:25.112 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:25.112 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:25.112 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:25.112 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:25.112 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:25.112 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:25.112 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:25.112 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:25.113 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:25.113 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:25.113 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:25.113 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:29.115 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:29.116 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:29.116 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:29.116 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:29.117 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:29.117 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:29.117 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:29.117 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:29.117 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:29.117 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:29.117 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:29.117 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:29.117 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:29.117 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:33.121 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:33.122 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:33.122 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:33.122 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:33.122 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:33.122 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:33.122 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:33.123 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:33.123 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:33.123 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:33.123 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:33.123 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:33.123 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:33.123 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:37.126 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:37.127 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:37.127 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:37.127 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:37.127 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:37.127 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:37.127 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:37.128 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:37.128 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:37.128 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:37.128 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:37.128 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:37.128 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:37.128 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:41.128 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:41.129 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:41.130 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:41.130 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:41.130 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:41.130 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:41.130 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:41.131 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:41.131 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:41.131 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:41.131 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:41.131 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:41.131 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:41.132 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:45.131 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:45.133 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:45.133 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:45.133 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:45.133 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:45.133 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:45.133 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:45.134 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:45.134 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:45.134 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:45.134 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:45.134 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:45.134 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:45.134 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:49.135 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:49.136 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:49.136 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:49.136 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:49.136 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:49.137 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:49.137 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:49.137 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:49.137 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:49.137 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:49.137 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:49.137 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:49.137 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:49.137 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:53.140 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:53.141 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:53.142 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:53.142 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:53.142 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:53.142 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:53.142 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:53.142 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:53.142 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:53.142 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:53.143 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:53.143 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:53.143 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:53.143 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:56.358 7fdf3fc40ac0 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3995-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15728588, partition_space_available_1k=65361896, percentage_partition_space_used=19, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=182660, cpu_share=0.0, mem_res=179480, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=48412, cpu_share=0.01, mem_res=38220, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=8257272, free=497572, buffers=581480, cached=6839316, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.94, five_min_avg=2.57, fifteen_min_avg=1.72, cpu_share=3.75, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 02:00:56.359 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:56.359 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 15728588 partition_space_available_1k = 65361896 percentage_partition_space_used = 19 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 182660 cpu_share = 0.0 mem_res = 179480 >>contrail-analytics-nodemgr : << mem_virt = 48412 cpu_share = 0.01 mem_res = 38220 >> } system_mem_usage = << total = 16175640 used = 8257272 free = 497572 buffers = 581480 cached = 6839316 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 1.94 five_min_avg = 2.57 fifteen_min_avg = 1.72 cpu_share = 3.75 node_type = analytics-node >> >> 09/01/2025 02:00:56.359 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:57.143 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:57.145 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:57.145 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:57.145 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:57.145 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:57.145 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:57.145 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:57.146 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:57.146 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:57.146 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:57.146 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:57.146 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:57.146 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:57.146 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:01.145 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:01.147 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:01.147 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:01.147 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:01.147 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:01.147 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:01.147 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:01.148 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:01.148 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:01.148 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:01.148 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:01.148 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:01.148 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:01.148 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:05.151 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:05.152 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:05.152 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:05.152 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:05.152 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:05.152 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:05.152 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:05.153 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:05.153 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:05.153 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:05.153 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:05.153 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:05.153 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:05.153 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:09.156 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:09.158 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:09.158 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:09.158 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:09.158 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:09.158 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:09.158 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:09.158 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:09.159 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:09.159 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:09.159 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:09.159 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:09.159 7fdf3cdb2680 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:09.159 7fdf3cdb2680 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:13.162 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:13.163 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:13.163 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:13.163 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:13.163 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:13.164 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:13.164 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:13.164 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:13.164 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:13.164 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:13.164 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:13.164 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:13.164 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:13.164 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:17.167 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:17.168 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:17.168 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:17.168 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:17.168 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:17.168 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:17.168 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:17.168 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:17.169 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:17.169 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:17.169 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:17.169 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:17.169 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:17.169 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:21.171 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:21.172 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:21.172 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:21.172 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:21.172 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:21.172 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:21.172 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:21.173 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:21.173 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:21.173 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:21.173 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:21.173 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:21.173 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:21.173 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:25.173 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:25.174 7fdf3cdb2900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:25.174 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:25.174 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:25.174 7fdf3cdb2900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:25.174 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:25.175 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:25.175 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:25.175 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:25.175 7fdf3cdb2900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:25.175 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:25.175 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:25.175 7fdf3cdb2900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:25.175 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:29.178 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:29.179 7fdf3cdb2900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:29.179 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:29.180 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:29.180 7fdf3cdb2900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:29.180 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:29.180 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:29.180 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:29.180 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:29.180 7fdf3cdb2900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:29.180 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:29.180 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:29.180 7fdf3cdb2900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:29.180 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:33.180 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:33.181 7fdf3cdb2900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:33.181 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:33.181 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:33.181 7fdf3cdb2900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:33.181 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:33.181 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:33.182 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:33.182 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:33.182 7fdf3cdb2900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:33.182 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:33.182 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:33.182 7fdf3cdb2900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:33.182 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:37.183 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:37.184 7fdf3cdb2900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:37.184 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:37.184 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:37.184 7fdf3cdb2900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:37.184 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:37.184 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:37.185 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:37.185 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:37.185 7fdf3cdb2900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:37.185 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:37.185 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:37.185 7fdf3cdb2900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:37.185 7fdf3cdb2900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:41.186 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:41.187 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:41.187 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:41.187 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:41.187 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:41.187 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:41.187 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:41.188 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:41.188 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:41.188 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:41.188 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:41.188 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:41.188 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:41.188 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:45.191 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:45.192 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:45.192 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:45.192 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:45.192 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:45.193 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:45.193 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:45.193 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:45.193 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:45.193 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:45.193 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:45.193 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:45.193 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:45.193 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:49.194 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:49.195 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:49.195 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:49.195 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:49.196 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:49.196 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:49.196 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:49.196 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:49.196 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:49.196 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:49.196 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:49.196 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:49.196 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:49.196 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:53.199 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:53.200 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:53.200 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:53.200 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:53.201 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:53.201 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:53.201 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:53.201 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:53.202 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:53.202 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:53.202 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:53.202 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:53.202 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:53.202 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:56.359 7fdf3fc40ac0 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3995-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15730604, partition_space_available_1k=65359880, percentage_partition_space_used=19, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=182728, cpu_share=0.0, mem_res=179480, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=48460, cpu_share=0.01, mem_res=38220, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=8282252, free=464980, buffers=581568, cached=6846840, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.04, five_min_avg=2.18, fifteen_min_avg=1.64, cpu_share=2.5, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 02:01:56.359 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:56.359 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 15730604 partition_space_available_1k = 65359880 percentage_partition_space_used = 19 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 182728 cpu_share = 0.0 mem_res = 179480 >>contrail-analytics-nodemgr : << mem_virt = 48460 cpu_share = 0.01 mem_res = 38220 >> } system_mem_usage = << total = 16175640 used = 8282252 free = 464980 buffers = 581568 cached = 6846840 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 1.04 five_min_avg = 2.18 fifteen_min_avg = 1.64 cpu_share = 2.5 node_type = analytics-node >> >> 09/01/2025 02:01:56.360 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:57.201 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:57.202 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:57.203 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:57.203 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:57.203 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:57.203 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:57.203 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:57.203 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:57.203 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:57.203 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:57.203 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:57.203 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:57.204 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:57.204 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:01.207 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:01.208 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:01.209 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:01.209 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:01.209 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:01.209 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:01.209 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:01.209 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:01.209 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:01.210 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:01.210 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:01.210 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:01.210 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:01.210 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:05.211 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:05.212 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:05.213 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:05.213 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:05.213 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:05.213 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:05.213 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:05.213 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:05.213 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:05.213 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:05.213 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:05.213 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:05.213 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:05.213 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:09.217 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:09.218 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:09.218 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:09.218 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:09.218 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:09.218 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:09.218 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:09.219 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:09.219 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:09.219 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:09.219 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:09.219 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:09.219 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:09.219 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:13.221 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:13.223 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:13.223 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:13.223 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:13.223 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:13.223 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:13.223 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:13.223 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:13.224 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:13.224 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:13.224 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:13.224 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:13.224 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:13.224 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:17.227 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:17.228 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:17.228 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:17.228 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:17.228 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:17.228 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:17.228 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:17.228 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:17.228 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:17.229 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:17.229 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:17.229 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:17.229 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:17.229 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:21.231 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:21.232 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:21.232 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:21.232 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:21.232 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:21.232 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:21.232 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:21.233 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:21.233 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:21.233 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:21.233 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:21.233 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:21.233 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:21.233 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:25.234 7fdf3cdb2b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:25.240 7fdf3cdb2b80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:25.240 7fdf3cdb2b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:25.240 7fdf3cdb2b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:25.240 7fdf3cdb2b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:25.240 7fdf3cdb2b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:25.240 7fdf3cdb2b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:25.240 7fdf3cdb2b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:25.240 7fdf3cdb2b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:25.241 7fdf3cdb2b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:25.241 7fdf3cdb2b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:25.241 7fdf3cdb2b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:25.241 7fdf3cdb2b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:25.241 7fdf3cdb2b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:29.243 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:29.244 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:29.244 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:29.244 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:29.245 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:29.245 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:29.245 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:29.245 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:29.245 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:29.245 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:29.245 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:29.245 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:29.246 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:29.246 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:33.247 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:33.248 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:33.248 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:33.248 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:33.248 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:33.248 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:33.248 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:33.249 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:33.249 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:33.249 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:33.249 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:33.249 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:33.249 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:33.249 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:37.251 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:37.253 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:37.253 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:37.253 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:37.253 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:37.253 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:37.253 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:37.253 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:37.253 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:37.253 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:37.253 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:37.254 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:37.254 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:37.254 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:41.254 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:41.255 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:41.255 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:41.255 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:41.255 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:41.255 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:41.255 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:41.256 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:41.256 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:41.256 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:41.256 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:41.256 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:41.256 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:41.256 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:45.259 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:45.260 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:45.260 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:45.260 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:45.261 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:45.261 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:45.261 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:45.261 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:45.261 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:45.261 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:45.261 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:45.261 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:45.261 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:45.261 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:49.264 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:49.265 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:49.265 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:49.265 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:49.265 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:49.265 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:49.266 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:49.266 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:49.266 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:49.266 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:49.266 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:49.266 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:49.266 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:49.266 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:53.268 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:53.269 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:53.269 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:53.269 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:53.269 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:53.269 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:53.270 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:53.270 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:53.270 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:53.270 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:53.271 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:53.271 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:53.271 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:53.271 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:56.357 7fdf3fc40ac0 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3995-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15732104, partition_space_available_1k=65358380, percentage_partition_space_used=19, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=182792, cpu_share=0.0, mem_res=179480, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=48508, cpu_share=0.01, mem_res=38220, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=8270468, free=473208, buffers=581856, cached=6850108, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.89, five_min_avg=1.92, fifteen_min_avg=1.58, cpu_share=2.5, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 02:02:56.357 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:56.358 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 15732104 partition_space_available_1k = 65358380 percentage_partition_space_used = 19 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 182792 cpu_share = 0.0 mem_res = 179480 >>contrail-analytics-nodemgr : << mem_virt = 48508 cpu_share = 0.01 mem_res = 38220 >> } system_mem_usage = << total = 16175640 used = 8270468 free = 473208 buffers = 581856 cached = 6850108 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 0.89 five_min_avg = 1.92 fifteen_min_avg = 1.58 cpu_share = 2.5 node_type = analytics-node >> >> 09/01/2025 02:02:56.358 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:57.271 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:57.272 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:57.272 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:57.272 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:57.273 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:57.273 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:57.273 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:57.273 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:57.273 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:57.273 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:57.273 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:57.273 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:57.274 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:57.274 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:01.277 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:01.278 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:01.278 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:01.278 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:01.279 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:01.279 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:01.279 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:01.279 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:01.279 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:01.279 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:01.279 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:01.279 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:01.279 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:01.279 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:05.279 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:05.280 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:05.280 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:05.280 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:05.280 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:05.280 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:05.280 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:05.280 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:05.281 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:05.281 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:05.281 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:05.281 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:05.281 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:05.281 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:09.282 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:09.283 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:09.284 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:09.284 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:09.284 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:09.284 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:09.284 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:09.284 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:09.284 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:09.284 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:09.284 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:09.284 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:09.285 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:09.285 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:13.285 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:13.286 7fdf3cdb22c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:13.286 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:13.286 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:13.286 7fdf3cdb22c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:13.286 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:13.286 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:13.287 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:13.287 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:13.287 7fdf3cdb22c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:13.287 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:13.287 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:13.287 7fdf3cdb22c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:13.287 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:17.289 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:17.290 7fdf3cdb22c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:17.290 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:17.290 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:17.290 7fdf3cdb22c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:17.290 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:17.290 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:17.290 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:17.290 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:17.290 7fdf3cdb22c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:17.290 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:17.290 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:17.291 7fdf3cdb22c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:17.291 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:21.292 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:21.293 7fdf3cdb22c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:21.293 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:21.293 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:21.294 7fdf3cdb22c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:21.294 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:21.294 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:21.294 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:21.294 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:21.294 7fdf3cdb22c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:21.294 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:21.294 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:21.294 7fdf3cdb22c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:21.294 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:25.297 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:25.298 7fdf3cdb22c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:25.298 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:25.298 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:25.298 7fdf3cdb22c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:25.298 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:25.298 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:25.299 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:25.299 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:25.299 7fdf3cdb22c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:25.299 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:25.299 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:25.299 7fdf3cdb22c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:25.299 7fdf3cdb22c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:29.300 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:29.301 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:29.301 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:29.301 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:29.301 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:29.301 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:29.301 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:29.302 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:29.302 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:29.302 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:29.302 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:29.302 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:29.302 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:29.302 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:33.305 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:33.306 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:33.306 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:33.306 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:33.307 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:33.307 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:33.307 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:33.307 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:33.307 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:33.307 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:33.307 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:33.308 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:33.308 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:33.308 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:37.311 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:37.312 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:37.312 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:37.312 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:37.313 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:37.313 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:37.313 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:37.313 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:37.313 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:37.313 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:37.313 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:37.313 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:37.314 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:37.314 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:41.313 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:41.314 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:41.314 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:41.314 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:41.314 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:41.314 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:41.314 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:41.315 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:41.315 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:41.315 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:41.315 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:41.315 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:41.315 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:41.315 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:45.315 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:45.317 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:45.317 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:45.317 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:45.317 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:45.317 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:45.317 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:45.318 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:45.318 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:45.318 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:45.318 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:45.318 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:45.318 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:45.318 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:49.321 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:49.322 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:49.322 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:49.322 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:49.323 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:49.323 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:49.323 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:49.323 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:49.323 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:49.323 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:49.323 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:49.323 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:49.323 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:49.323 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:53.326 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:53.327 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:53.327 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:53.327 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:53.328 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:53.328 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:53.328 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:53.328 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:53.328 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:53.328 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:53.328 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:53.328 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:53.328 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:53.328 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:56.371 7fdf3fc40ac0 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3995-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15734576, partition_space_available_1k=65355908, percentage_partition_space_used=19, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=182852, cpu_share=0.0, mem_res=179480, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=48576, cpu_share=0.01, mem_res=38220, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=8271716, free=469184, buffers=581888, cached=6852852, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.48, five_min_avg=1.61, fifteen_min_avg=1.5, cpu_share=2.75, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 02:03:56.372 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:56.372 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 15734576 partition_space_available_1k = 65355908 percentage_partition_space_used = 19 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 182852 cpu_share = 0.0 mem_res = 179480 >>contrail-analytics-nodemgr : << mem_virt = 48576 cpu_share = 0.01 mem_res = 38220 >> } system_mem_usage = << total = 16175640 used = 8271716 free = 469184 buffers = 581888 cached = 6852852 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 0.48 five_min_avg = 1.61 fifteen_min_avg = 1.5 cpu_share = 2.75 node_type = analytics-node >> >> 09/01/2025 02:03:56.372 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:57.328 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:57.330 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:57.330 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:57.330 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:57.330 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:57.330 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:57.330 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:57.330 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:57.331 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:57.331 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:57.331 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:57.331 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:57.331 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:57.331 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:01.334 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:01.335 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:01.336 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:01.336 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:01.336 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:01.336 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:01.336 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:01.336 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:01.336 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:01.336 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:01.336 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:01.336 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:01.337 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:01.337 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:05.339 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:05.340 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:05.340 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:05.340 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:05.340 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:05.340 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:05.340 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:05.340 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:05.340 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:05.341 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:05.341 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:05.341 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:05.341 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:05.341 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:09.343 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:09.344 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:09.344 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:09.344 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:09.344 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:09.344 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:09.344 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:09.345 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:09.345 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:09.345 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:09.345 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:09.345 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:09.345 7fdf3d1f4e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:09.345 7fdf3d1f4e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:13.347 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:13.348 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:13.348 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:13.349 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:13.349 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:13.349 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:13.349 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:13.349 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:13.349 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:13.349 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:13.349 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:13.349 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:13.349 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:13.349 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:17.351 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:17.352 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:17.353 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:17.353 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:17.353 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:17.353 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:17.353 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:17.353 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:17.353 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:17.353 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:17.353 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:17.353 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:17.353 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:17.353 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:21.357 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:21.358 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:21.358 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:21.358 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:21.358 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:21.358 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:21.358 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:21.359 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:21.359 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:21.359 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:21.359 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:21.359 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:21.359 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:21.359 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:25.362 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:25.364 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:25.364 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:25.364 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:25.365 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:25.365 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:25.365 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:25.365 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:25.365 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:25.365 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:25.365 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:25.365 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:25.365 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:25.366 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:29.368 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:29.369 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:29.369 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:29.369 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:29.369 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:29.369 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:29.369 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:29.369 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:29.369 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:29.370 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:29.370 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:29.370 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:29.370 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:29.370 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:33.371 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:33.372 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:33.372 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:33.372 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:33.372 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:33.373 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:33.373 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:33.373 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:33.373 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:33.373 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:33.373 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:33.373 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:33.373 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:33.373 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:37.377 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:37.378 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:37.378 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:37.378 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:37.378 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:37.378 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:37.378 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:37.379 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:37.379 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:37.379 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:37.379 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:37.379 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:37.379 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:37.379 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:41.379 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:41.380 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:41.380 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:41.380 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:41.380 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:41.380 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:41.380 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:41.380 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:41.380 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:41.381 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:41.381 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:41.381 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:41.381 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:41.381 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:45.383 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:45.384 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:45.384 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:45.384 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:45.384 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:45.384 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:45.384 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:45.385 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:45.385 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:45.385 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:45.385 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:45.385 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:45.385 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:45.385 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:49.387 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:49.389 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:49.389 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:49.389 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:49.389 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:49.389 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:49.389 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:49.390 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:49.390 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:49.390 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:49.390 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:49.390 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:49.390 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:49.390 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:53.390 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:53.391 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:53.391 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:53.391 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:53.392 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:53.392 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:53.392 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:53.392 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:53.392 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:53.392 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:53.392 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:53.392 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:53.392 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:53.392 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:56.368 7fdf3fc40ac0 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3995-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15736164, partition_space_available_1k=65354320, percentage_partition_space_used=19, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=182920, cpu_share=0.0, mem_res=179480, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=48628, cpu_share=0.01, mem_res=38220, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=8271804, free=467680, buffers=581920, cached=6854236, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.39, five_min_avg=1.38, fifteen_min_avg=1.42, cpu_share=2.75, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 02:04:56.369 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:56.369 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 15736164 partition_space_available_1k = 65354320 percentage_partition_space_used = 19 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 182920 cpu_share = 0.0 mem_res = 179480 >>contrail-analytics-nodemgr : << mem_virt = 48628 cpu_share = 0.01 mem_res = 38220 >> } system_mem_usage = << total = 16175640 used = 8271804 free = 467680 buffers = 581920 cached = 6854236 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 0.39 five_min_avg = 1.38 fifteen_min_avg = 1.42 cpu_share = 2.75 node_type = analytics-node >> >> 09/01/2025 02:04:56.369 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:57.393 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:57.394 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:57.394 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:57.395 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:57.395 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:57.395 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:57.395 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:57.395 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:57.395 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:57.395 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:57.395 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:57.395 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:57.395 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:57.396 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:01.399 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:01.400 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:01.400 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:01.401 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:01.401 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:01.401 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:01.401 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:01.401 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:01.401 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:01.401 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:01.401 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:01.402 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:01.402 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:01.402 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:05.405 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:05.406 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:05.406 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:05.406 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:05.406 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:05.406 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:05.406 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:05.407 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:05.407 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:05.407 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:05.407 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:05.407 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:05.407 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:05.407 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:09.410 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:09.412 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:09.412 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:09.412 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:09.412 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:09.412 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:09.412 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:09.412 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:09.413 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:09.413 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:09.413 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:09.413 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:09.413 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:09.413 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:13.414 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:13.415 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:13.415 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:13.415 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:13.415 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:13.415 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:13.415 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:13.416 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:13.416 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:13.416 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:13.416 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:13.416 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:13.416 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:13.416 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:17.419 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:17.420 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:17.420 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:17.420 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:17.420 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:17.420 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:17.420 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:17.421 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:17.421 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:17.421 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:17.421 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:17.421 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:17.421 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:17.421 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:21.423 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:21.424 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:21.424 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:21.424 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:21.425 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:21.425 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:21.425 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:21.425 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:21.425 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:21.425 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:21.425 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:21.425 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:21.425 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:21.425 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:25.429 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:25.430 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:25.430 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:25.430 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:25.430 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:25.430 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:25.431 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:25.431 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:25.431 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:25.431 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:25.431 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:25.431 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:25.431 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:25.431 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:29.432 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:29.433 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:29.433 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:29.433 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:29.433 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:29.434 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:29.434 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:29.434 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:29.434 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:29.434 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:29.434 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:29.434 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:29.434 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:29.435 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:33.437 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:33.439 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:33.439 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:33.439 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:33.439 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:33.439 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:33.439 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:33.439 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:33.439 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:33.440 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:33.440 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:33.440 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:33.440 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:33.440 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:37.443 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:37.444 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:37.445 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:37.445 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:37.445 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:37.445 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:37.445 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:37.445 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:37.445 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:37.445 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:37.446 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:37.446 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:37.446 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:37.446 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:41.447 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:41.448 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:41.448 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:41.448 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:41.448 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:41.448 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:41.448 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:41.449 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:41.449 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:41.449 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:41.449 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:41.449 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:41.449 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:41.449 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:45.451 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:45.452 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:45.452 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:45.452 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:45.452 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:45.453 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:45.453 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:45.453 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:45.453 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:45.453 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:45.453 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:45.453 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:45.453 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:45.453 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:49.456 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:49.457 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:49.457 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:49.457 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:49.458 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:49.458 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:49.458 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:49.458 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:49.458 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:49.458 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:49.458 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:49.458 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:49.458 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:49.458 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:53.458 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:53.460 7fdf3cdb89a0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:53.460 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:53.460 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:53.460 7fdf3cdb89a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:53.460 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:53.460 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:53.461 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:53.461 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:53.461 7fdf3cdb89a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:53.461 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:53.461 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:53.461 7fdf3cdb89a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:53.461 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:56.369 7fdf3fc40ac0 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3995-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15737588, partition_space_available_1k=65352896, percentage_partition_space_used=19, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=182980, cpu_share=0.0, mem_res=179480, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=48676, cpu_share=0.01, mem_res=38220, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=8266044, free=472056, buffers=581948, cached=6855592, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.68, five_min_avg=1.29, fifteen_min_avg=1.39, cpu_share=2.5, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 02:05:56.369 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:56.369 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 15737588 partition_space_available_1k = 65352896 percentage_partition_space_used = 19 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 182980 cpu_share = 0.0 mem_res = 179480 >>contrail-analytics-nodemgr : << mem_virt = 48676 cpu_share = 0.01 mem_res = 38220 >> } system_mem_usage = << total = 16175640 used = 8266044 free = 472056 buffers = 581948 cached = 6855592 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 0.68 five_min_avg = 1.29 fifteen_min_avg = 1.39 cpu_share = 2.5 node_type = analytics-node >> >> 09/01/2025 02:05:56.369 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:57.461 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:57.463 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:57.463 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:57.463 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:57.463 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:57.463 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:57.463 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:57.463 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:57.464 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:57.464 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:57.464 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:57.464 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:57.464 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:57.464 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:01.466 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:01.468 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:01.468 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:01.468 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:01.468 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:01.468 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:01.468 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:01.469 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:01.469 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:01.469 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:01.469 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:01.469 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:01.469 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:01.469 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:05.473 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:05.473 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:05.474 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:05.474 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:05.474 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:05.474 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:05.474 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:05.474 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:05.474 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:05.474 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:05.474 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:05.474 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:05.475 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:05.475 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:09.477 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:09.479 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:09.479 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:09.479 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:09.479 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:09.479 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:09.479 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:09.480 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:09.480 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:09.480 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:09.480 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:09.480 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:09.480 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:09.480 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:13.479 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:13.480 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:13.481 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:13.481 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:13.481 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:13.481 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:13.481 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:13.481 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:13.481 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:13.481 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:13.481 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:13.481 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:13.482 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:13.482 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:17.483 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:17.484 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:17.484 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:17.484 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:17.484 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:17.484 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:17.484 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:17.485 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:17.485 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:17.485 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:17.485 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:17.485 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:17.485 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:17.485 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:21.487 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:21.488 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:21.488 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:21.488 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:21.488 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:21.488 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:21.489 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:21.489 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:21.489 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:21.489 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:21.489 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:21.489 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:21.489 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:21.489 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:25.492 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:25.494 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:25.494 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:25.494 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:25.494 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:25.494 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:25.494 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:25.494 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:25.494 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:25.494 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:25.494 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:25.495 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:25.495 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:25.495 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:29.496 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:29.498 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:29.499 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:29.499 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:29.499 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:29.499 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:29.499 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:29.499 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:29.499 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:29.500 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:29.500 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:29.500 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:29.500 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:29.500 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:33.502 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:33.503 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:33.503 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:33.504 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:33.504 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:33.504 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:33.504 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:33.504 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:33.504 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:33.504 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:33.505 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:33.505 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:33.505 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:33.505 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:37.508 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:37.509 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:37.509 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:37.509 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:37.509 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:37.509 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:37.509 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:37.510 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:37.510 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:37.510 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:37.510 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:37.510 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:37.510 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:37.510 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:41.512 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:41.513 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:41.513 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:41.513 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:41.514 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:41.514 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:41.514 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:41.514 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:41.514 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:41.514 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:41.514 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:41.514 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:41.514 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:41.514 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:45.516 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:45.517 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:45.518 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:45.518 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:45.518 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:45.518 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:45.518 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:45.518 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:45.518 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:45.518 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:45.518 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:45.518 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:45.519 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:45.519 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:49.519 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:49.520 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:49.520 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:49.520 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:49.520 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:49.520 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:49.521 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:49.521 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:49.521 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:49.521 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:49.521 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:49.521 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:49.521 7fdf3d1f4900 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:49.521 7fdf3d1f4900 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:53.521 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:53.523 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:53.523 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:53.523 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:53.523 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:53.523 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:53.523 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:53.524 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:53.524 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:53.524 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:53.524 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:53.524 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:53.524 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:53.524 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:56.369 7fdf3fc40ac0 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3995-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15739912, partition_space_available_1k=65350572, percentage_partition_space_used=19, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=183040, cpu_share=0.0, mem_res=179480, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=48724, cpu_share=0.01, mem_res=38220, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=8310932, free=424608, buffers=582136, cached=6857964, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.6, five_min_avg=1.15, fifteen_min_avg=1.33, cpu_share=3.0, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 02:06:56.370 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:56.370 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 15739912 partition_space_available_1k = 65350572 percentage_partition_space_used = 19 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 183040 cpu_share = 0.0 mem_res = 179480 >>contrail-analytics-nodemgr : << mem_virt = 48724 cpu_share = 0.01 mem_res = 38220 >> } system_mem_usage = << total = 16175640 used = 8310932 free = 424608 buffers = 582136 cached = 6857964 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 0.6 five_min_avg = 1.15 fifteen_min_avg = 1.33 cpu_share = 3.0 node_type = analytics-node >> >> 09/01/2025 02:06:56.370 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:57.524 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:57.525 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:57.525 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:57.525 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:57.525 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:57.525 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:57.526 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:57.526 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:57.526 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:57.526 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:57.526 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:57.526 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:57.526 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:57.526 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:01.527 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:01.528 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:01.529 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:01.529 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:01.529 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:01.529 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:01.529 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:01.529 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:01.529 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:01.530 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:01.530 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:01.530 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:01.530 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:01.530 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:05.531 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:05.532 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:05.532 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:05.532 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:05.532 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:05.532 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:05.532 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:05.533 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:05.533 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:05.533 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:05.533 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:05.533 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:05.533 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:05.533 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:09.534 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:09.536 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:09.536 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:09.536 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:09.536 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:09.536 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:09.536 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:09.536 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:09.536 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:09.536 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:09.536 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:09.537 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:09.537 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:09.537 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:13.538 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:13.539 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:13.539 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:13.539 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:13.539 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:13.539 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:13.539 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:13.539 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:13.540 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:13.540 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:13.540 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:13.540 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:13.540 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:13.540 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:17.543 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:17.544 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:17.544 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:17.544 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:17.544 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:17.544 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:17.544 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:17.544 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:17.544 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:17.545 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:17.545 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:17.545 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:17.545 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:17.545 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:21.547 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:21.548 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:21.548 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:21.548 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:21.548 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:21.549 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:21.549 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:21.549 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:21.549 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:21.549 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:21.549 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:21.549 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:21.549 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:21.549 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:25.550 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:25.551 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:25.552 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:25.552 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:25.552 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:25.552 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:25.552 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:25.552 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:25.552 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:25.552 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:25.552 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:25.552 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:25.553 7fdf3cdb20e0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:25.553 7fdf3cdb20e0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:29.553 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:29.554 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:29.554 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:29.554 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:29.555 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:29.555 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:29.555 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:29.555 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:29.555 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:29.555 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:29.555 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:29.555 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:29.555 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:29.555 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:33.559 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:33.560 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:33.560 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:33.560 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:33.560 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:33.560 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:33.560 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:33.561 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:33.561 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:33.561 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:33.561 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:33.561 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:33.561 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:33.561 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:37.563 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:37.565 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:37.565 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:37.565 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:37.565 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:37.565 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:37.565 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:37.565 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:37.565 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:37.566 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:37.566 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:37.566 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:37.566 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:37.566 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:41.567 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:41.568 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:41.568 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:41.568 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:41.568 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:41.568 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:41.568 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:41.568 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:41.569 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:41.569 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:41.569 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:41.569 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:41.569 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:41.569 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:45.571 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:45.572 7fdf3cdb2720 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:45.573 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:45.573 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:45.573 7fdf3cdb2720 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:45.573 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:45.573 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:45.573 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:45.573 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:45.573 7fdf3cdb2720 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:45.573 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:45.574 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:45.574 7fdf3cdb2720 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:45.574 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:49.576 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:49.577 7fdf3cdb2720 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:49.577 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:49.577 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:49.578 7fdf3cdb2720 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:49.578 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:49.578 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:49.578 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:49.578 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:49.578 7fdf3cdb2720 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:49.578 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:49.578 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:49.578 7fdf3cdb2720 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:49.579 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:53.578 7fdf3d1f4f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:53.580 7fdf3d1f4f40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:53.580 7fdf3d1f4f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:53.580 7fdf3d1f4f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:53.580 7fdf3d1f4f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:53.580 7fdf3d1f4f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:53.580 7fdf3d1f4f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:53.580 7fdf3d1f4f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:53.581 7fdf3d1f4f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:53.581 7fdf3d1f4f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:53.581 7fdf3d1f4f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:53.581 7fdf3d1f4f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:53.581 7fdf3d1f4f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:53.581 7fdf3d1f4f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:56.376 7fdf3fc40ac0 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3995-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15741340, partition_space_available_1k=65349144, percentage_partition_space_used=19, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=183112, cpu_share=0.0, mem_res=179480, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=48772, cpu_share=0.01, mem_res=38220, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=8331384, free=402444, buffers=582144, cached=6859668, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.33, five_min_avg=0.97, fifteen_min_avg=1.26, cpu_share=2.25, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 02:07:56.376 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:56.376 7fdf3cdb2720 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 15741340 partition_space_available_1k = 65349144 percentage_partition_space_used = 19 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 183112 cpu_share = 0.0 mem_res = 179480 >>contrail-analytics-nodemgr : << mem_virt = 48772 cpu_share = 0.01 mem_res = 38220 >> } system_mem_usage = << total = 16175640 used = 8331384 free = 402444 buffers = 582144 cached = 6859668 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 0.33 five_min_avg = 0.97 fifteen_min_avg = 1.26 cpu_share = 2.25 node_type = analytics-node >> >> 09/01/2025 02:07:56.376 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:57.582 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:57.583 7fdf3cdb2720 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:57.583 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:57.583 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:57.583 7fdf3cdb2720 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:57.584 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:57.584 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:57.584 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:57.584 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:57.584 7fdf3cdb2720 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:57.584 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:57.584 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:57.584 7fdf3cdb2720 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:57.584 7fdf3cdb2720 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:01.587 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:01.589 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:01.589 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:01.589 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:01.589 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:01.589 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:01.589 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:01.590 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:01.590 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:01.590 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:01.590 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:01.590 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:01.590 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:01.590 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:05.593 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:05.594 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:05.594 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:05.594 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:05.595 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:05.595 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:05.595 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:05.595 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:05.595 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:05.595 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:05.595 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:05.595 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:05.595 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:05.595 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:09.595 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:09.596 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:09.596 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:09.596 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:09.596 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:09.596 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:09.596 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:09.597 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:09.597 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:09.597 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:09.597 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:09.597 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:09.597 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:09.597 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:13.597 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:13.599 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:13.599 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:13.599 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:13.599 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:13.599 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:13.599 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:13.599 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:13.600 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:13.600 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:13.600 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:13.600 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:13.600 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:13.600 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:17.603 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:17.604 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:17.604 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:17.604 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:17.604 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:17.604 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:17.604 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:17.605 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:17.605 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:17.605 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:17.605 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:17.605 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:17.605 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:17.605 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:21.608 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:21.609 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:21.610 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:21.610 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:21.610 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:21.610 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:21.610 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:21.610 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:21.610 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:21.610 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:21.610 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:21.611 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:21.611 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:21.611 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:25.614 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:25.615 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:25.615 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:25.615 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:25.615 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:25.616 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:25.616 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:25.616 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:25.616 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:25.616 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:25.616 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:25.616 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:25.616 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:25.616 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:29.616 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:29.617 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:29.617 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:29.617 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:29.617 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:29.617 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:29.617 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:29.617 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:29.618 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:29.618 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:29.618 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:29.618 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:29.618 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:29.618 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:33.619 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:33.620 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:33.620 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:33.620 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:33.620 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:33.620 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:33.620 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:33.621 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:33.621 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:33.621 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:33.621 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:33.621 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:33.621 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:33.621 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:37.623 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:37.625 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:37.625 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:37.625 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:37.625 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:37.625 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:37.625 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:37.626 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:37.626 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:37.626 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:37.626 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:37.626 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:37.626 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:37.626 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:41.629 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:41.630 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:41.630 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:41.630 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:41.630 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:41.630 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:41.630 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:41.631 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:41.631 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:41.631 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:41.631 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:41.631 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:41.631 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:41.631 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:45.631 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:45.633 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:45.633 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:45.633 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:45.633 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:45.633 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:45.633 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:45.633 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:45.633 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:45.634 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:45.634 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:45.634 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:45.634 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:45.634 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:49.635 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:49.636 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:49.636 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:49.636 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:49.636 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:49.637 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:49.637 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:49.637 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:49.637 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:49.637 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:49.637 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:49.637 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:49.637 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:49.637 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:53.637 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:53.639 7fdf3cdb2e00 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:53.639 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:53.639 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:53.639 7fdf3cdb2e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:53.639 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:53.639 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:53.639 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:53.639 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:53.640 7fdf3cdb2e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:53.640 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:53.640 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:53.640 7fdf3cdb2e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:53.640 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:56.387 7fdf3fc40ac0 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3995-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15742776, partition_space_available_1k=65347708, percentage_partition_space_used=19, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=183168, cpu_share=0.0, mem_res=179480, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=48824, cpu_share=0.01, mem_res=38220, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=8339192, free=393044, buffers=582160, cached=6861244, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.67, five_min_avg=0.95, fifteen_min_avg=1.23, cpu_share=2.75, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 02:08:56.387 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:56.387 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 15742776 partition_space_available_1k = 65347708 percentage_partition_space_used = 19 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 183168 cpu_share = 0.0 mem_res = 179480 >>contrail-analytics-nodemgr : << mem_virt = 48824 cpu_share = 0.01 mem_res = 38220 >> } system_mem_usage = << total = 16175640 used = 8339192 free = 393044 buffers = 582160 cached = 6861244 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 0.67 five_min_avg = 0.95 fifteen_min_avg = 1.23 cpu_share = 2.75 node_type = analytics-node >> >> 09/01/2025 02:08:56.387 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:57.639 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:57.640 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:57.640 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:57.640 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:57.640 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:57.640 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:57.640 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:57.641 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:57.641 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:57.641 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:57.641 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:57.641 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:57.641 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:57.641 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:01.643 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:01.644 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:01.644 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:01.644 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:01.645 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:01.645 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:01.645 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:01.645 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:01.645 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:01.645 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:01.645 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:01.645 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:01.645 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:01.646 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:05.645 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:05.646 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:05.646 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:05.646 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:05.646 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:05.647 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:05.647 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:05.647 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:05.647 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:05.647 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:05.647 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:05.647 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:05.647 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:05.647 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:09.650 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:09.651 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:09.651 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:09.651 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:09.651 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:09.652 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:09.652 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:09.652 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:09.652 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:09.652 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:09.652 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:09.652 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:09.652 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:09.652 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:13.652 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:13.654 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:13.654 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:13.654 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:13.654 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:13.654 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:13.654 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:13.654 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:13.654 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:13.655 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:13.655 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:13.655 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:13.655 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:13.655 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:17.658 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:17.658 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:17.659 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:17.659 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:17.659 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:17.659 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:17.659 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:17.659 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:17.659 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:17.659 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:17.659 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:17.659 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:17.660 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:17.660 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:21.663 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:21.664 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:21.664 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:21.664 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:21.664 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:21.664 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:21.664 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:21.665 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:21.665 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:21.665 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:21.665 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:21.665 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:21.665 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:21.665 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:25.668 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:25.670 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:25.670 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:25.670 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:25.670 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:25.670 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:25.670 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:25.670 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:25.671 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:25.671 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:25.671 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:25.671 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:25.671 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:25.671 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:29.671 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:29.672 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:29.672 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:29.672 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:29.672 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:29.673 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:29.673 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:29.673 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:29.673 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:29.673 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:29.673 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:29.673 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:29.673 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:29.674 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:33.675 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:33.677 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:33.677 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:33.677 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:33.677 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:33.677 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:33.677 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:33.677 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:33.677 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:33.678 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:33.678 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:33.678 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:33.678 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:33.678 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:37.679 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:37.680 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:37.680 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:37.680 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:37.680 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:37.680 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:37.680 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:37.681 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:37.681 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:37.681 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:37.681 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:37.681 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:37.681 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:37.681 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:41.684 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:41.685 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:41.685 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:41.685 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:41.685 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:41.685 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:41.685 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:41.686 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:41.686 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:41.686 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:41.686 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:41.686 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:41.686 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:41.686 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:45.686 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:45.687 7fdf3cdb89a0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:45.688 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:45.688 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:45.688 7fdf3cdb89a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:45.688 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:45.688 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:45.688 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:45.688 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:45.689 7fdf3cdb89a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:45.689 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:45.689 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:45.689 7fdf3cdb89a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:45.689 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:49.692 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:49.693 7fdf3cdb89a0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:49.693 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:49.693 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:49.693 7fdf3cdb89a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:49.693 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:49.693 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:49.694 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:49.694 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:49.694 7fdf3cdb89a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:49.694 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:49.694 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:49.694 7fdf3cdb89a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:49.694 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:53.694 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:53.695 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:53.695 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:53.695 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:53.695 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:53.696 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:53.696 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:53.696 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:53.696 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:53.696 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:53.696 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:53.696 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:53.696 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:53.696 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:56.389 7fdf3fc40ac0 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3995-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15744380, partition_space_available_1k=65346104, percentage_partition_space_used=19, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=183232, cpu_share=0.0, mem_res=179480, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=48872, cpu_share=0.01, mem_res=38220, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=8347188, free=383452, buffers=582196, cached=6862804, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.51, five_min_avg=0.86, fifteen_min_avg=1.18, cpu_share=2.75, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 02:09:56.390 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:56.390 7fdf3cdb89a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 15744380 partition_space_available_1k = 65346104 percentage_partition_space_used = 19 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 183232 cpu_share = 0.0 mem_res = 179480 >>contrail-analytics-nodemgr : << mem_virt = 48872 cpu_share = 0.01 mem_res = 38220 >> } system_mem_usage = << total = 16175640 used = 8347188 free = 383452 buffers = 582196 cached = 6862804 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 0.51 five_min_avg = 0.86 fifteen_min_avg = 1.18 cpu_share = 2.75 node_type = analytics-node >> >> 09/01/2025 02:09:56.390 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:57.697 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:57.698 7fdf3cdb89a0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:57.698 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:57.698 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:57.698 7fdf3cdb89a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:57.698 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:57.698 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:57.699 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:57.699 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:57.699 7fdf3cdb89a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:57.699 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:57.699 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:57.699 7fdf3cdb89a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:57.699 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:01.700 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:01.701 7fdf3cdb8720 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:01.702 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:01.702 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:01.702 7fdf3cdb8720 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:01.702 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:01.702 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:01.702 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:01.702 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:01.703 7fdf3cdb8720 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:01.703 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:01.703 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:01.703 7fdf3cdb8720 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:01.703 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:05.703 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:05.704 7fdf3cdb8720 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:05.704 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:05.704 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:05.704 7fdf3cdb8720 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:05.704 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:05.704 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:05.704 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:05.704 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:05.705 7fdf3cdb8720 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:05.705 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:05.705 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:05.705 7fdf3cdb8720 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:05.705 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:09.706 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:09.707 7fdf3cdb8720 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:09.707 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:09.708 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:09.708 7fdf3cdb8720 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:09.708 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:09.708 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:09.708 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:09.708 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:09.708 7fdf3cdb8720 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:09.708 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:09.708 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:09.708 7fdf3cdb8720 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:09.708 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:13.711 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:13.712 7fdf3cdb8720 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:13.712 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:13.712 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:13.712 7fdf3cdb8720 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:13.713 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:13.713 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:13.713 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:13.713 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:13.713 7fdf3cdb8720 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:13.713 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:13.713 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:13.713 7fdf3cdb8720 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:13.713 7fdf3cdb8720 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:17.715 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:17.716 7fdf3cdb2e00 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:17.716 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:17.716 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:17.716 7fdf3cdb2e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:17.716 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:17.716 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:17.717 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:17.717 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:17.717 7fdf3cdb2e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:17.717 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:17.717 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:17.717 7fdf3cdb2e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:17.717 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:21.718 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:21.719 7fdf3cdb2e00 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:21.720 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:21.720 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:21.720 7fdf3cdb2e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:21.720 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:21.720 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:21.720 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:21.720 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:21.721 7fdf3cdb2e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:21.721 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:21.721 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:21.721 7fdf3cdb2e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:21.721 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:25.724 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:25.725 7fdf3cdb2e00 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:25.725 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:25.726 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:25.726 7fdf3cdb2e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:25.726 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:25.726 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:25.726 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:25.726 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:25.726 7fdf3cdb2e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:25.726 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:25.726 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:25.726 7fdf3cdb2e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:25.726 7fdf3cdb2e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:29.726 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:29.728 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:29.728 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:29.728 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:29.728 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:29.728 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:29.728 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:29.728 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:29.729 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:29.729 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:29.729 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:29.729 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:29.729 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:29.729 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:33.729 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:33.730 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:33.731 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:33.731 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:33.731 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:33.731 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:33.731 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:33.731 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:33.731 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:33.731 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:33.731 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:33.731 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:33.732 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:33.732 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:37.735 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:37.736 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:37.736 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:37.736 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:37.736 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:37.737 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:37.737 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:37.737 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:37.737 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:37.737 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:37.737 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:37.737 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:37.737 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:37.737 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:41.740 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:41.741 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:41.742 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:41.742 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:41.742 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:41.742 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:41.742 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:41.742 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:41.742 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:41.742 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:41.743 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:41.743 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:41.743 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:41.743 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:45.743 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:45.745 7fdf3cdb8d60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:45.745 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:45.745 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:45.745 7fdf3cdb8d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:45.745 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:45.745 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:45.745 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:45.746 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:45.746 7fdf3cdb8d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:45.746 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:45.746 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:45.746 7fdf3cdb8d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:45.746 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:49.746 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:49.747 7fdf3cdb8d60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:49.748 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:49.748 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:49.748 7fdf3cdb8d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:49.748 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:49.748 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:49.748 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:49.748 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:49.749 7fdf3cdb8d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:49.749 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:49.749 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:49.749 7fdf3cdb8d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:49.749 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:53.749 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:53.750 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:53.750 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:53.751 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:53.751 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:53.751 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:53.751 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:53.751 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:53.751 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:53.751 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:53.751 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:53.752 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:53.752 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:53.752 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:56.388 7fdf3fc40ac0 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3995-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15745812, partition_space_available_1k=65344672, percentage_partition_space_used=19, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=183292, cpu_share=0.0, mem_res=179480, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=48916, cpu_share=0.01, mem_res=38220, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=8338424, free=390688, buffers=582220, cached=6864308, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.38, five_min_avg=0.76, fifteen_min_avg=1.13, cpu_share=2.5, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 02:10:56.388 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:56.388 7fdf3cdb8d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 15745812 partition_space_available_1k = 65344672 percentage_partition_space_used = 19 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 183292 cpu_share = 0.0 mem_res = 179480 >>contrail-analytics-nodemgr : << mem_virt = 48916 cpu_share = 0.01 mem_res = 38220 >> } system_mem_usage = << total = 16175640 used = 8338424 free = 390688 buffers = 582220 cached = 6864308 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 0.38 five_min_avg = 0.76 fifteen_min_avg = 1.13 cpu_share = 2.5 node_type = analytics-node >> >> 09/01/2025 02:10:56.388 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:57.752 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:57.753 7fdf3cdb8d60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:57.754 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:57.754 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:57.754 7fdf3cdb8d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:57.754 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:57.754 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:57.754 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:57.754 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:57.754 7fdf3cdb8d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:57.754 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:57.754 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:57.755 7fdf3cdb8d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:57.755 7fdf3cdb8d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:01.755 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:01.756 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:01.757 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:01.757 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:01.757 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:01.757 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:01.757 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:01.757 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:01.757 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:01.757 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:01.757 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:01.757 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:01.757 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:01.758 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:05.760 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:05.761 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:05.761 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:05.761 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:05.761 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:05.762 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:05.762 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:05.762 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:05.762 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:05.762 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:05.762 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:05.762 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:05.762 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:05.762 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:09.765 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:09.767 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:09.767 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:09.767 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:09.767 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:09.767 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:09.767 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:09.767 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:09.768 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:09.768 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:09.768 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:09.768 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:09.768 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:09.768 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:13.771 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:13.772 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:13.773 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:13.773 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:13.773 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:13.773 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:13.773 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:13.773 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:13.773 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:13.773 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:13.773 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:13.773 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:13.773 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:13.773 7fdf3cdb2ae0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:17.774 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:17.775 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:17.775 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:17.775 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:17.775 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:17.775 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:17.775 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:17.776 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:17.776 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:17.776 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:17.776 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:17.776 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:17.776 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:17.776 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:21.776 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:21.778 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:21.778 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:21.778 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:21.778 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:21.778 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:21.778 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:21.778 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:21.778 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:21.778 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:21.779 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:21.779 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:21.779 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:21.779 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:25.781 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:25.782 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:25.782 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:25.782 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:25.782 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:25.782 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:25.782 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:25.783 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:25.783 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:25.783 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:25.783 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:25.783 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:25.783 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:25.783 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:29.783 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:29.784 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:29.784 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:29.784 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:29.784 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:29.784 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:29.784 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:29.785 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:29.785 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:29.785 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:29.785 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:29.785 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:29.785 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:29.785 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:33.787 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:33.788 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:33.788 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:33.788 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:33.788 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:33.788 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:33.788 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:33.789 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:33.789 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:33.789 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:33.789 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:33.789 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:33.789 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:33.789 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:37.792 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:37.793 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:37.793 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:37.793 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:37.793 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:37.793 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:37.793 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:37.794 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:37.794 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:37.794 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:37.794 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:37.794 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:37.794 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:37.794 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:41.796 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:41.797 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:41.797 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:41.797 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:41.797 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:41.797 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:41.797 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:41.798 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:41.798 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:41.798 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:41.798 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:41.798 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:41.798 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:41.798 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:45.799 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:45.800 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:45.800 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:45.800 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:45.801 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:45.801 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:45.801 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:45.801 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:45.801 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:45.802 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:45.802 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:45.802 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:45.802 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:45.802 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:49.801 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:49.802 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:49.803 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:49.803 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:49.803 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:49.803 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:49.803 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:49.803 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:49.803 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:49.803 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:49.803 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:49.804 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:49.804 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:49.804 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:53.803 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:53.804 7fdf3cdb89a0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:53.805 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:53.805 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:53.805 7fdf3cdb89a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:53.805 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:53.805 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:53.805 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:53.805 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:53.805 7fdf3cdb89a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:53.805 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:53.805 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:53.806 7fdf3cdb89a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:53.806 7fdf3cdb89a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:56.392 7fdf3fc40ac0 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3995-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15747748, partition_space_available_1k=65342736, percentage_partition_space_used=19, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=183360, cpu_share=0.0, mem_res=179480, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=48964, cpu_share=0.01, mem_res=38220, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=8331728, free=405100, buffers=582264, cached=6856548, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.58, five_min_avg=0.76, fifteen_min_avg=1.1, cpu_share=2.75, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 02:11:56.393 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:56.393 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 15747748 partition_space_available_1k = 65342736 percentage_partition_space_used = 19 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 183360 cpu_share = 0.0 mem_res = 179480 >>contrail-analytics-nodemgr : << mem_virt = 48964 cpu_share = 0.01 mem_res = 38220 >> } system_mem_usage = << total = 16175640 used = 8331728 free = 405100 buffers = 582264 cached = 6856548 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 0.58 five_min_avg = 0.76 fifteen_min_avg = 1.1 cpu_share = 2.75 node_type = analytics-node >> >> 09/01/2025 02:11:56.393 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:57.807 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:57.808 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:57.808 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:57.808 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:57.808 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:57.808 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:57.809 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:57.809 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:57.809 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:57.809 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:57.809 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:57.809 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:57.809 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:57.809 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:01.811 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:01.812 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:01.812 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:01.812 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:01.812 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:01.812 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:01.812 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:01.813 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:01.813 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:01.813 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:01.813 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:01.813 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:01.813 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:01.813 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:05.815 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:05.816 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:05.816 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:05.816 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:05.816 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:05.816 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:05.816 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:05.817 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:05.817 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:05.817 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:05.817 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:05.817 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:05.817 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:05.817 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:09.819 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:09.820 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:09.820 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:09.820 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:09.821 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:09.821 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:09.821 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:09.821 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:09.821 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:09.821 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:09.821 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:09.821 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:09.821 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:09.821 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:13.823 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:13.824 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:13.824 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:13.824 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:13.825 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:13.825 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:13.825 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:13.825 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:13.825 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:13.825 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:13.825 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:13.825 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:13.825 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:13.825 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:17.827 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:17.828 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:17.828 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:17.828 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:17.828 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:17.828 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:17.828 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:17.829 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:17.829 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:17.829 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:17.829 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:17.829 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:17.829 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:17.829 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:21.833 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:21.834 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:21.834 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:21.834 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:21.834 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:21.834 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:21.834 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:21.834 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:21.835 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:21.835 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:21.835 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:21.835 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:21.835 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:21.835 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:25.837 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:25.838 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:25.838 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:25.838 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:25.838 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:25.838 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:25.838 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:25.839 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:25.839 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:25.839 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:25.839 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:25.839 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:25.839 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:25.839 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:29.841 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:29.842 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:29.842 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:29.842 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:29.842 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:29.842 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:29.842 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:29.842 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:29.843 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:29.843 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:29.843 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:29.843 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:29.843 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:29.843 7fdf3cdb2ea0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:33.843 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:33.844 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:33.844 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:33.844 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:33.844 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:33.844 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:33.844 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:33.845 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:33.845 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:33.845 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:33.845 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:33.845 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:33.845 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:33.845 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:37.848 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:37.850 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:37.850 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:37.850 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:37.850 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:37.850 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:37.850 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:37.850 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:37.851 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:37.851 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:37.851 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:37.851 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:37.851 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:37.851 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:41.854 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:41.855 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:41.855 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:41.855 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:41.855 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:41.855 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:41.855 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:41.856 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:41.856 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:41.856 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:41.856 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:41.856 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:41.856 7fdf3cdb8f40 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:41.856 7fdf3cdb8f40 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:45.856 7fdf3cdb8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:45.858 7fdf3cdb8b80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:45.858 7fdf3cdb8b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:45.858 7fdf3cdb8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:45.858 7fdf3cdb8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:45.858 7fdf3cdb8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:45.858 7fdf3cdb8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:45.859 7fdf3cdb8b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:45.859 7fdf3cdb8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:45.859 7fdf3cdb8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:45.859 7fdf3cdb8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:45.859 7fdf3cdb8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:45.859 7fdf3cdb8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:45.859 7fdf3cdb8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:49.861 7fdf3cdb8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:49.862 7fdf3cdb8b80 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:49.863 7fdf3cdb8b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:49.863 7fdf3cdb8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:49.863 7fdf3cdb8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:49.863 7fdf3cdb8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:49.863 7fdf3cdb8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:49.863 7fdf3cdb8b80 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:49.863 7fdf3cdb8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:49.863 7fdf3cdb8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:49.863 7fdf3cdb8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:49.864 7fdf3cdb8b80 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:49.864 7fdf3cdb8b80 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:49.864 7fdf3cdb8b80 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:53.864 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:53.865 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:53.865 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:53.865 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:53.866 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:53.866 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:53.866 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:53.866 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:53.866 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:53.866 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:53.866 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:53.866 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:53.866 7fdf3cdb2860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:53.866 7fdf3cdb2860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:56.393 7fdf3fc40ac0 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3995-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15749184, partition_space_available_1k=65341300, percentage_partition_space_used=19, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=183440, cpu_share=0.0, mem_res=179480, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=49020, cpu_share=0.01, mem_res=38220, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=8338460, free=396752, buffers=582332, cached=6858096, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.59, five_min_avg=0.74, fifteen_min_avg=1.07, cpu_share=2.25, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 02:12:56.393 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:56.394 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 15749184 partition_space_available_1k = 65341300 percentage_partition_space_used = 19 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 183440 cpu_share = 0.0 mem_res = 179480 >>contrail-analytics-nodemgr : << mem_virt = 49020 cpu_share = 0.01 mem_res = 38220 >> } system_mem_usage = << total = 16175640 used = 8338460 free = 396752 buffers = 582332 cached = 6858096 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 0.59 five_min_avg = 0.74 fifteen_min_avg = 1.07 cpu_share = 2.25 node_type = analytics-node >> >> 09/01/2025 02:12:56.394 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:57.867 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:57.868 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:57.868 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:57.868 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:57.869 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:57.869 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:57.869 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:57.869 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:57.869 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:57.869 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:57.869 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:57.869 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:57.869 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:57.869 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:01.870 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:01.871 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:01.871 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:01.871 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:01.872 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:01.872 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:01.872 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:01.872 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:01.872 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:01.872 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:01.872 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:01.872 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:01.872 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:01.872 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:05.874 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:05.875 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:05.875 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:05.875 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:05.875 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:05.875 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:05.875 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:05.876 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:05.876 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:05.876 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:05.876 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:05.876 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:05.876 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:05.876 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:09.878 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:09.879 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:09.879 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:09.879 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:09.879 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:09.879 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:09.879 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:09.880 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:09.880 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:09.880 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:09.880 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:09.880 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:09.880 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:09.880 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:13.883 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:13.884 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:13.884 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:13.884 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:13.884 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:13.884 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:13.885 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:13.885 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:13.885 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:13.885 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:13.885 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:13.885 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:13.885 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:13.885 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:17.886 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:17.887 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:17.888 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:17.888 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:17.888 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:17.888 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:17.888 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:17.888 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:17.888 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:17.888 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:17.888 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:17.888 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:17.888 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:17.888 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:21.891 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:21.892 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:21.892 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:21.892 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:21.893 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:21.893 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:21.893 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:21.893 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:21.893 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:21.893 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:21.893 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:21.893 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:21.893 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:21.893 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:25.896 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:25.897 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:25.898 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:25.898 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:25.898 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:25.898 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:25.898 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:25.898 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:25.898 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:25.898 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:25.898 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:25.898 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:25.899 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:25.899 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:29.900 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:29.901 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:29.901 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:29.901 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:29.901 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:29.901 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:29.901 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:29.901 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:29.901 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:29.902 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:29.902 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:29.902 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:29.902 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:29.902 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:33.904 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:33.906 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:33.906 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:33.906 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:33.906 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:33.906 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:33.906 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:33.906 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:33.907 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:33.907 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:33.907 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:33.907 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:33.907 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:33.907 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:37.908 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:37.910 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:37.910 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:37.910 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:37.910 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:37.910 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:37.910 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:37.910 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:37.910 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:37.910 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:37.910 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:37.910 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:37.910 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:37.911 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:41.911 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:41.912 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:41.912 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:41.912 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:41.912 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:41.912 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:41.912 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:41.912 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:41.913 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:41.913 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:41.913 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:41.913 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:41.913 7fdf3d1f4c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:41.913 7fdf3d1f4c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:45.913 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:45.914 7fdf3cdb2d60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:45.914 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:45.914 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:45.915 7fdf3cdb2d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:45.915 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:45.915 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:45.915 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:45.915 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:45.915 7fdf3cdb2d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:45.915 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:45.915 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:45.915 7fdf3cdb2d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:45.915 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:49.915 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:49.916 7fdf3cdb2d60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:49.916 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:49.916 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:49.916 7fdf3cdb2d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:49.916 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:49.916 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:49.917 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:49.917 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:49.917 7fdf3cdb2d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:49.917 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:49.917 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:49.917 7fdf3cdb2d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:49.917 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:53.917 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:53.919 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:53.919 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:53.919 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:53.919 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:53.919 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:53.919 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:53.920 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:53.920 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:53.920 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:53.920 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:53.920 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:53.920 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:53.920 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:56.406 7fdf3fc40ac0 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3995-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15750588, partition_space_available_1k=65339896, percentage_partition_space_used=19, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=183488, cpu_share=0.0, mem_res=179480, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=49068, cpu_share=0.01, mem_res=38220, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=8334156, free=399724, buffers=582360, cached=6859400, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.59, five_min_avg=0.71, fifteen_min_avg=1.04, cpu_share=2.75, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 02:13:56.406 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:56.406 7fdf3cdb2d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 15750588 partition_space_available_1k = 65339896 percentage_partition_space_used = 19 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 183488 cpu_share = 0.0 mem_res = 179480 >>contrail-analytics-nodemgr : << mem_virt = 49068 cpu_share = 0.01 mem_res = 38220 >> } system_mem_usage = << total = 16175640 used = 8334156 free = 399724 buffers = 582360 cached = 6859400 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 0.59 five_min_avg = 0.71 fifteen_min_avg = 1.04 cpu_share = 2.75 node_type = analytics-node >> >> 09/01/2025 02:13:56.407 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:57.919 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:57.921 7fdf3cdb2d60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:57.921 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:57.921 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:57.921 7fdf3cdb2d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:57.921 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:57.921 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:57.922 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:57.922 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:57.922 7fdf3cdb2d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:57.922 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:57.922 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:57.922 7fdf3cdb2d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:57.922 7fdf3cdb2d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:01.923 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:01.924 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:01.924 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:01.924 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:01.924 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:01.924 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:01.924 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:01.925 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:01.925 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:01.925 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:01.925 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:01.925 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:01.925 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:01.925 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:05.928 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:05.929 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:05.929 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:05.929 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:05.929 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:05.930 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:05.930 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:05.930 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:05.930 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:05.930 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:05.930 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:05.930 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:05.930 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:05.930 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:09.932 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:09.933 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:09.933 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:09.933 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:09.933 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:09.933 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:09.933 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:09.934 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:09.934 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:09.934 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:09.934 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:09.934 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:09.934 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:09.934 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:13.935 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:13.936 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:13.936 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:13.936 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:13.936 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:13.936 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:13.936 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:13.937 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:13.937 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:13.937 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:13.937 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:13.937 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:13.937 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:13.937 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:17.938 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:17.939 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:17.939 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:17.939 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:17.939 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:17.940 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:17.940 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:17.940 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:17.940 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:17.940 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:17.940 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:17.940 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:17.940 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:17.940 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:21.943 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:21.944 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:21.944 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:21.944 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:21.944 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:21.944 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:21.944 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:21.945 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:21.945 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:21.945 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:21.945 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:21.945 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:21.945 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:21.945 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:25.947 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:25.948 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:25.948 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:25.949 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:25.949 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:25.949 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:25.949 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:25.949 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:25.949 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:25.949 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:25.949 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:25.949 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:25.950 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:25.950 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:29.951 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:29.952 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:29.952 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:29.952 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:29.952 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:29.952 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:29.952 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:29.952 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:29.952 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:29.953 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:29.953 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:29.953 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:29.953 7fdf3cdb24a0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:29.953 7fdf3cdb24a0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:33.953 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:33.955 7fdf3cdb8e00 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:33.955 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:33.955 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:33.955 7fdf3cdb8e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:33.955 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:33.955 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:33.955 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:33.956 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:33.956 7fdf3cdb8e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:33.956 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:33.956 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:33.956 7fdf3cdb8e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:33.956 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:37.959 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:37.960 7fdf3cdb8e00 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:37.960 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:37.960 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:37.960 7fdf3cdb8e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:37.961 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:37.961 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:37.961 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:37.961 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:37.961 7fdf3cdb8e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:37.961 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:37.961 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:37.961 7fdf3cdb8e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:37.961 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:41.963 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:41.964 7fdf3cdb8e00 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:41.964 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:41.964 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:41.964 7fdf3cdb8e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:41.964 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:41.964 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:41.965 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:41.965 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:41.965 7fdf3cdb8e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:41.965 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:41.965 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:41.965 7fdf3cdb8e00 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:41.965 7fdf3cdb8e00 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:45.965 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:45.967 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:45.967 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:45.967 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:45.967 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:45.967 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:45.967 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:45.967 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:45.968 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:45.968 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:45.968 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:45.968 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:45.968 7fdf3cdb8860 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:45.968 7fdf3cdb8860 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:49.971 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:49.972 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:49.972 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:49.972 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:49.973 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:49.973 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:49.973 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:49.973 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:49.973 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:49.973 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:49.973 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:49.973 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:49.973 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:49.973 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:53.974 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:53.975 7fdf3cdb27c0 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:53.975 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:53.975 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:53.976 7fdf3cdb27c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:53.976 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:53.976 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:53.976 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:53.976 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:53.976 7fdf3cdb27c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:53.976 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:53.976 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:53.976 7fdf3cdb27c0 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:53.977 7fdf3cdb27c0 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:56.400 7fdf3fc40ac0 [contrail-analytics-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3995-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15763540, partition_space_available_1k=65326944, percentage_partition_space_used=19, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-analytics-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=183548, cpu_share=0.0, mem_res=179480, _EventManager__key='contrail-analytics-api'), 'contrail-analytics-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=49120, cpu_share=0.01, mem_res=38220, _EventManager__key='contrail-analytics-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=8340144, free=357128, buffers=583080, cached=6895288, node_type='analytics-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.5, five_min_avg=0.67, fifteen_min_avg=1.0, cpu_share=2.75, node_type='analytics-node'), running_package_version=None, installed_package_version=None, _table='ObjectCollectorInfo') 09/01/2025 02:14:56.400 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:56.400 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 15763540 partition_space_available_1k = 65326944 percentage_partition_space_used = 19 >> } process_mem_cpu_usage = { contrail-analytics-api : << mem_virt = 183548 cpu_share = 0.0 mem_res = 179480 >>contrail-analytics-nodemgr : << mem_virt = 49120 cpu_share = 0.01 mem_res = 38220 >> } system_mem_usage = << total = 16175640 used = 8340144 free = 357128 buffers = 583080 cached = 6895288 node_type = analytics-node >> system_cpu_usage = << one_min_avg = 0.5 five_min_avg = 0.67 fifteen_min_avg = 1.0 cpu_share = 2.75 node_type = analytics-node >> >> 09/01/2025 02:14:56.400 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:57.977 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:57.978 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:57.978 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:57.978 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:57.978 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:57.978 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:57.978 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:57.978 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:57.979 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:57.979 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:57.979 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:57.979 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:57.979 7fdf3d1f4d60 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:57.979 7fdf3d1f4d60 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:01.311 7fdf3cdb8c20 [contrail-analytics-nodemgr] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:15:01.979 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:01.980 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:01.980 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:01.980 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:01.980 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:01.980 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:01.981 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:01.981 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:01.981 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:01.981 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:01.981 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:01.981 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:01.981 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:15:01.981 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:05.983 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:05.984 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:05.984 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:05.984 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:05.984 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:05.984 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:05.985 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:05.985 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:05.985 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:05.985 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1. process_status = [ << module_id = contrail-analytics-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:05.985 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:05.985 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:05.985 7fdf3cdb8c20 [contrail-analytics-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-1.:Analytics:contrail-analytics-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8104 start_time = 1756691933022723 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:15:05.985 7fdf3cdb8c20 [contrail-analytics-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]