06/02/2025 02:06:09.963 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 06/02/2025 02:06:09.963 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 06/02/2025 02:06:09.963 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 06/02/2025 02:06:09.973 7fc3a9dff048 [contrail-analytics-snmp-nodemgr] [ERROR]: Cannot write http_port 8114 to /tmp/contrail-analytics-snmp-nodemgr.0.http_port 06/02/2025 02:06:09.974 7fc3a9dff048 [contrail-analytics-snmp-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8114 06/02/2025 02:06:09.974 7fc3a9e03978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvStart] in state[none] 06/02/2025 02:06:09.975 7fc3a9e03978 [contrail-analytics-snmp-nodemgr] [DEBUG]: Add uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:06:09.975 7fc3a9e03978 [contrail-analytics-snmp-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 06/02/2025 02:06:09.976 7fc3a9e03978 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 06/02/2025 02:06:09.976 7fc3a9e03978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:09.976 7fc3a9e03978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 06/02/2025 02:06:09.976 7fc3a9e03978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:09.976 7fc3a9e03978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:09.976 7fc3a9e03978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 06/02/2025 02:06:09.976 7fc3a9e03978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:10.041 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-snmp-collector', 'group': 'contrail-snmp-collector', 'pid': 33758112993224687445679310545906688039282777862106798963343098100636350106622, 'start': '1748829967000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-topology', 'group': 'contrail-topology', 'pid': 102058819368804570290181393759048363956233115816504813557580303076652291341030, 'start': '1748829967000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-analytics-snmp-nodemgr', 'group': 'contrail-analytics-snmp-nodemgr', 'pid': 87876899485417340334927461001309884993247675914105295609628085513957061317208, 'start': '1748829967000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 06/02/2025 02:06:10.205 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-snmp-nodemgr', _source='cn-jenkins-deploy-platform-juju-os-542-1', _node_type='AnalyticsSNMP', _instance_id='0', _timestamp=1748829970205179, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-analytics-snmp-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo'), _seqnum=0) 06/02/2025 02:06:10.207 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-snmp-nodemgr', _source='cn-jenkins-deploy-platform-juju-os-542-1', _node_type='AnalyticsSNMP', _instance_id='0', _timestamp=1748829970206963, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-snmp-collector', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1748829967000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-topology', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1748829967000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-snmp-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1748829967000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-06-02 00:52:12.596288", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9311-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo'), _seqnum=0) 06/02/2025 02:06:10.212 7fc3b30e4a20 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:10.213 7fc3b30e4a20 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-06-02 00:52:12.596288", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9311-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 8 num_core_per_socket = 8 num_thread_per_core = 1 >> running_package_version = nightly-nightly.el7 installed_package_version = nightly-nightly.el7 >> 06/02/2025 02:06:10.213 7fc3b30e4a20 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:10.213 7fc3b30e4a20 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:10.214 7fc3b30e4a20 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 06/02/2025 02:06:10.214 7fc3b30e4a20 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:10.214 7fc3b30e4a20 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:10.214 7fc3b30e4a20 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 deleted = False process_info = [ << process_name = contrail-snmp-collector process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1748829967000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-topology process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1748829967000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-analytics-snmp-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1748829967000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-06-02 00:52:12.596288", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9311-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 06/02/2025 02:06:10.214 7fc3b30e4a20 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:11.227 7fc3a9e166d8 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:06:13.976 7fc3a9dd4eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:06:15.686 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-snmp-nodemgr', _source='cn-jenkins-deploy-platform-juju-os-542-1', _node_type='AnalyticsSNMP', _instance_id='0', _timestamp=1748829975685927, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-snmp-collector', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1748829967000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-topology', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1748829967000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-snmp-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1748829967000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-06-02 00:52:12.596288", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9311-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo'), _seqnum=0) 06/02/2025 02:06:15.686 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51097220, partition_space_available_1k=29993264, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1604, cpu_share=0.0, mem_res=804, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1620, cpu_share=0.0, mem_res=800, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50628, cpu_share=0.0, mem_res=39632, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=11382124, free=552896, buffers=938640, cached=19791460, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.54, five_min_avg=3.42, fifteen_min_avg=2.48, cpu_share=0, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:06:18.983 7fc3a9dd4eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:06:18.983 7fc3a9dd4eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:06:18.984 7fc3a9dd4eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:06:18.984 7fc3a9dd4eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:06:18.984 7fc3a9dd4eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:06:18.984 7fc3a9dd4eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:06:18.984 7fc3a9dd4eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 deleted = False process_info = [ << process_name = contrail-snmp-collector process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1748829967000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-topology process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1748829967000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-analytics-snmp-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1748829967000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-06-02 00:52:12.596288", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9311-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 06/02/2025 02:06:18.985 7fc3a9dd4eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:06:18.985 7fc3a9dd4eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:06:18.985 7fc3a9dd4eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51097220 partition_space_available_1k = 29993264 percentage_partition_space_used = 63 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 1604 cpu_share = 0.0 mem_res = 804 >>contrail-topology : << mem_virt = 1620 cpu_share = 0.0 mem_res = 800 >>contrail-analytics-snmp-nodemgr : << mem_virt = 50628 cpu_share = 0.0 mem_res = 39632 >> } system_mem_usage = << total = 32665120 used = 11382124 free = 552896 buffers = 938640 cached = 19791460 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 4.54 five_min_avg = 3.42 fifteen_min_avg = 2.48 cpu_share = 0 node_type = analytics-snmp-node >> >> 06/02/2025 02:06:18.985 7fc3a9dd4eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:06:18.985 7fc3a9dd4eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:06:18.986 7fc3a9dd4eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:06:18.986 7fc3a9dd4eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:18.987 7fc3a9dd4eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:06:18.987 7fc3a9dd4eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:18.988 7fc3a9dd4eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:18.988 7fc3a9dd4eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:06:18.988 7fc3a9dd4eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:20.754 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:06:22.986 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:06:27.991 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:06:27.991 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:06:27.992 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:06:27.992 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:06:27.992 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:06:27.992 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:06:27.992 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:06:27.993 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:27.993 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:06:27.993 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:27.993 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:27.993 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:06:27.993 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:31.788 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:06:31.991 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:06:36.999 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:06:36.999 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:06:36.999 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:06:36.999 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:06:36.999 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:06:36.999 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:06:37.000 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:06:37.000 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:37.000 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:06:37.000 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:37.001 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:37.001 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:06:37.001 7fc3b2af7240 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:40.999 7fc3a9db54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:06:46.005 7fc3a9db54e0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:06:46.005 7fc3a9db54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:06:46.005 7fc3a9db54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:06:46.005 7fc3a9db54e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:06:46.005 7fc3a9db54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:06:46.005 7fc3a9db54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:06:46.006 7fc3a9db54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:06:46.006 7fc3a9db54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:46.006 7fc3a9db54e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:06:46.006 7fc3a9db54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:46.006 7fc3a9db54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:46.006 7fc3a9db54e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:06:46.006 7fc3a9db54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:50.008 7fc3a9db54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:06:52.341 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:06:55.015 7fc3a9db54e0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:06:55.016 7fc3a9db54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:06:55.016 7fc3a9db54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:06:55.016 7fc3a9db54e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:06:55.016 7fc3a9db54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:06:55.016 7fc3a9db54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:06:55.020 7fc3a9db54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:06:55.020 7fc3a9db54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:55.021 7fc3a9db54e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:06:55.021 7fc3a9db54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:55.021 7fc3a9db54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:55.021 7fc3a9db54e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:06:55.021 7fc3a9db54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:06:59.018 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:07:04.025 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:07:04.025 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:07:04.025 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:04.026 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:07:04.026 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:04.026 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:07:04.028 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:07:04.029 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:04.029 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:07:04.029 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:04.029 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:04.029 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:07:04.029 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:04.656 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:07:08.027 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:07:13.032 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:07:13.033 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:07:13.033 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:13.033 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:07:13.033 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:13.033 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:07:13.034 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:07:13.034 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:13.034 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:07:13.034 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:13.034 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:13.034 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:07:13.034 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:15.571 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51218944, partition_space_available_1k=29871540, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1520, cpu_share=0.0, mem_res=804, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18720, cpu_share=0.01, mem_res=15704, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=41832, cpu_share=0.01, mem_res=39624, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=14697780, free=11632060, buffers=974100, cached=5361180, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=10.77, five_min_avg=5.19, fifteen_min_avg=3.14, cpu_share=8.5, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:07:15.571 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:15.572 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51218944 partition_space_available_1k = 29871540 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 1520 cpu_share = 0.0 mem_res = 804 >>contrail-topology : << mem_virt = 18720 cpu_share = 0.01 mem_res = 15704 >>contrail-analytics-snmp-nodemgr : << mem_virt = 41832 cpu_share = 0.01 mem_res = 39624 >> } system_mem_usage = << total = 32665120 used = 14697780 free = 11632060 buffers = 974100 cached = 5361180 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 10.77 five_min_avg = 5.19 fifteen_min_avg = 3.14 cpu_share = 8.5 node_type = analytics-snmp-node >> >> 06/02/2025 02:07:15.572 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:17.034 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:07:17.998 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:07:22.040 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:07:22.041 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:07:22.041 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:22.041 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:07:22.041 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:22.041 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:07:22.041 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:07:22.042 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:22.042 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:07:22.042 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:22.042 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:22.042 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:07:22.042 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:26.044 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:07:31.055 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:07:31.055 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:07:31.055 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:31.055 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:07:31.055 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:31.084 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:07:31.086 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:07:31.086 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:31.086 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:07:31.086 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:31.087 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:31.087 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:07:31.087 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:35.068 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:07:40.077 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:07:40.077 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:07:40.077 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:40.077 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:07:40.077 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:40.078 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:07:40.078 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:07:40.078 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:40.079 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:07:40.079 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:40.079 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:40.079 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:07:40.079 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:40.561 7fc3a9dfbe10 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:07:44.078 7fc3aa63f978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:07:49.085 7fc3aa63f978 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:07:49.085 7fc3aa63f978 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:07:49.085 7fc3aa63f978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:49.085 7fc3aa63f978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:07:49.085 7fc3aa63f978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:49.085 7fc3aa63f978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:07:49.086 7fc3aa63f978 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:07:49.086 7fc3aa63f978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:49.086 7fc3aa63f978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:07:49.087 7fc3aa63f978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:49.087 7fc3aa63f978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:49.087 7fc3aa63f978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:07:49.087 7fc3aa63f978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:53.089 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:07:58.092 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:07:58.092 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:07:58.092 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:58.092 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:07:58.092 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:58.092 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:07:58.093 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:07:58.093 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:58.093 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:07:58.093 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:58.093 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:58.094 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:07:58.094 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:02.092 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:08:07.099 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:08:07.100 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:08:07.100 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:07.100 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:08:07.100 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:07.100 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:08:07.101 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:08:07.101 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:07.101 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:08:07.101 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:07.101 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:07.101 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:08:07.101 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:11.101 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:08:15.112 7fc3a9dd1198 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:08:15.682 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51261712, partition_space_available_1k=29828772, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82336, cpu_share=0.12, mem_res=75680, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74592, cpu_share=0.11, mem_res=69580, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=41888, cpu_share=0.01, mem_res=39624, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=14822644, free=10580144, buffers=987932, cached=6274400, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=17.49, five_min_avg=8.85, fifteen_min_avg=4.57, cpu_share=9.38, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:08:16.104 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:08:16.104 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:08:16.104 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:16.104 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:08:16.105 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:16.105 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:16.105 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51261712 partition_space_available_1k = 29828772 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 82336 cpu_share = 0.12 mem_res = 75680 >>contrail-topology : << mem_virt = 74592 cpu_share = 0.11 mem_res = 69580 >>contrail-analytics-snmp-nodemgr : << mem_virt = 41888 cpu_share = 0.01 mem_res = 39624 >> } system_mem_usage = << total = 32665120 used = 14822644 free = 10580144 buffers = 987932 cached = 6274400 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 17.49 five_min_avg = 8.85 fifteen_min_avg = 4.57 cpu_share = 9.38 node_type = analytics-snmp-node >> >> 06/02/2025 02:08:16.105 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:16.105 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:08:16.106 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:08:16.106 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:16.106 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:08:16.106 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:16.106 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:16.106 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:08:16.106 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:20.110 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:08:25.116 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:08:25.116 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:08:25.116 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:25.116 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:08:25.116 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:25.116 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:08:25.117 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:08:25.117 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:25.117 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:08:25.117 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:25.117 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:25.117 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:08:25.117 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:29.117 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:08:30.367 7fc3accd0828 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:08:34.122 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:08:34.122 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:08:34.123 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:34.123 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:08:34.123 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:34.123 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:08:34.123 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:08:34.123 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:34.123 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:08:34.124 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:34.124 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:34.124 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:08:34.124 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:38.127 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:08:43.129 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:08:43.129 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:08:43.130 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:43.130 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:08:43.130 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:43.130 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:08:43.130 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:08:43.130 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:43.131 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:08:43.131 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:43.131 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:43.131 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:08:43.131 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:47.132 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:08:52.106 7fc3a9db88d0 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:08:52.142 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:08:52.143 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:08:52.143 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:52.143 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:08:52.143 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:52.143 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:08:52.144 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:08:52.144 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:52.144 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:08:52.144 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:52.144 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:52.144 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:08:52.144 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:56.145 7fc3a9db88d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:09:01.150 7fc3a9db88d0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:09:01.150 7fc3a9db88d0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:09:01.150 7fc3a9db88d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:01.151 7fc3a9db88d0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:09:01.151 7fc3a9db88d0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:01.151 7fc3a9db88d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:09:01.151 7fc3a9db88d0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:09:01.151 7fc3a9db88d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:01.152 7fc3a9db88d0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:09:01.152 7fc3a9db88d0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:01.152 7fc3a9db88d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:01.152 7fc3a9db88d0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:09:01.152 7fc3a9db88d0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:02.533 7fc3aa646e10 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:09:05.153 7fc3aa646e10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:09:10.159 7fc3aa646e10 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:09:10.160 7fc3aa646e10 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:09:10.160 7fc3aa646e10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:10.160 7fc3aa646e10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:09:10.160 7fc3aa646e10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:10.160 7fc3aa646e10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:09:10.161 7fc3aa646e10 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:09:10.161 7fc3aa646e10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:10.161 7fc3aa646e10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:09:10.161 7fc3aa646e10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:10.161 7fc3aa646e10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:10.161 7fc3aa646e10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:09:10.161 7fc3aa646e10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:14.161 7fc3accba828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:09:15.682 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51280192, partition_space_available_1k=29810292, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82712, cpu_share=0.05, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74568, cpu_share=0.02, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=41912, cpu_share=0.01, mem_res=39624, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15232092, free=11218844, buffers=990816, cached=5223368, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=10.85, five_min_avg=8.63, fifteen_min_avg=4.77, cpu_share=5.0, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:09:19.166 7fc3accba828 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:09:19.166 7fc3accba828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:09:19.166 7fc3accba828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:19.166 7fc3accba828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:09:19.166 7fc3accba828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:19.166 7fc3accba828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:19.167 7fc3accba828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51280192 partition_space_available_1k = 29810292 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 82712 cpu_share = 0.05 mem_res = 75780 >>contrail-topology : << mem_virt = 74568 cpu_share = 0.02 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 41912 cpu_share = 0.01 mem_res = 39624 >> } system_mem_usage = << total = 32665120 used = 15232092 free = 11218844 buffers = 990816 cached = 5223368 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 10.85 five_min_avg = 8.63 fifteen_min_avg = 4.77 cpu_share = 5.0 node_type = analytics-snmp-node >> >> 06/02/2025 02:09:19.167 7fc3accba828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:19.167 7fc3accba828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:09:19.168 7fc3accba828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:09:19.168 7fc3accba828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:19.168 7fc3accba828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:09:19.168 7fc3accba828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:19.168 7fc3accba828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:19.168 7fc3accba828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:09:19.168 7fc3accba828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:23.169 7fc3a9e16cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:09:28.175 7fc3a9e16cc0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:09:28.175 7fc3a9e16cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:09:28.175 7fc3a9e16cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:28.175 7fc3a9e16cc0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:09:28.175 7fc3a9e16cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:28.175 7fc3a9e16cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:09:28.176 7fc3a9e16cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:09:28.176 7fc3a9e16cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:28.176 7fc3a9e16cc0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:09:28.176 7fc3a9e16cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:28.176 7fc3a9e16cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:28.176 7fc3a9e16cc0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:09:28.176 7fc3a9e16cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:32.179 7fc3a9dbf048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:09:37.186 7fc3a9dbf048 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:09:37.186 7fc3a9dbf048 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:09:37.186 7fc3a9dbf048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:37.187 7fc3a9dbf048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:09:37.187 7fc3a9dbf048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:37.187 7fc3a9dbf048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:09:37.188 7fc3a9dbf048 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:09:37.188 7fc3a9dbf048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:37.188 7fc3a9dbf048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:09:37.188 7fc3a9dbf048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:37.188 7fc3a9dbf048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:37.188 7fc3a9dbf048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:09:37.188 7fc3a9dbf048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:41.191 7fc3a9dbf048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:09:46.195 7fc3a9dbf048 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:09:46.195 7fc3a9dbf048 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:09:46.195 7fc3a9dbf048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:46.195 7fc3a9dbf048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:09:46.195 7fc3a9dbf048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:46.195 7fc3a9dbf048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:09:46.196 7fc3a9dbf048 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:09:46.196 7fc3a9dbf048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:46.196 7fc3a9dbf048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:09:46.196 7fc3a9dbf048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:46.196 7fc3a9dbf048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:46.196 7fc3a9dbf048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:09:46.196 7fc3a9dbf048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:50.199 7fc3ace560f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:09:55.205 7fc3ace560f0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:09:55.205 7fc3ace560f0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:09:55.205 7fc3ace560f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:55.206 7fc3ace560f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:09:55.206 7fc3ace560f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:55.206 7fc3ace560f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:09:55.207 7fc3ace560f0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:09:55.207 7fc3ace560f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:55.207 7fc3ace560f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:09:55.207 7fc3ace560f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:55.207 7fc3ace560f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:55.207 7fc3ace560f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:09:55.208 7fc3ace560f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:59.206 7fc3accd0e10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:10:04.213 7fc3accd0e10 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:10:04.213 7fc3accd0e10 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:10:04.213 7fc3accd0e10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:04.213 7fc3accd0e10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:10:04.213 7fc3accd0e10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:04.213 7fc3accd0e10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:10:04.214 7fc3accd0e10 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:10:04.214 7fc3accd0e10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:04.214 7fc3accd0e10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:10:04.214 7fc3accd0e10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:04.214 7fc3accd0e10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:04.214 7fc3accd0e10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:10:04.214 7fc3accd0e10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:08.217 7fc3accd0e10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:10:13.221 7fc3accd0e10 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:10:13.221 7fc3accd0e10 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:10:13.221 7fc3accd0e10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:13.221 7fc3accd0e10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:10:13.222 7fc3accd0e10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:13.222 7fc3accd0e10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:10:13.222 7fc3accd0e10 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:10:13.222 7fc3accd0e10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:13.222 7fc3accd0e10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:10:13.222 7fc3accd0e10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:13.223 7fc3accd0e10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:13.223 7fc3accd0e10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:10:13.223 7fc3accd0e10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:15.681 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51287816, partition_space_available_1k=29802668, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82700, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74560, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=41908, cpu_share=0.01, mem_res=39624, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15142388, free=11138348, buffers=990904, cached=5393480, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.61, five_min_avg=7.56, fifteen_min_avg=4.64, cpu_share=3.62, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:10:15.681 7fc3a9dd1198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:15.682 7fc3a9dd1198 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51287816 partition_space_available_1k = 29802668 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 82700 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 74560 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 41908 cpu_share = 0.01 mem_res = 39624 >> } system_mem_usage = << total = 32665120 used = 15142388 free = 11138348 buffers = 990904 cached = 5393480 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 5.61 five_min_avg = 7.56 fifteen_min_avg = 4.64 cpu_share = 3.62 node_type = analytics-snmp-node >> >> 06/02/2025 02:10:15.682 7fc3a9dd1198 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:17.222 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:10:22.229 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:10:22.229 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:10:22.229 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:22.230 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:10:22.231 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:22.231 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:10:22.231 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:10:22.232 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:22.233 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:10:22.233 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:22.233 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:22.233 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:10:22.233 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:23.539 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:10:26.232 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:10:31.236 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:10:31.236 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:10:31.236 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:31.236 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:10:31.236 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:31.236 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:10:31.237 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:10:31.237 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:31.237 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:10:31.237 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:31.237 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:31.237 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:10:31.237 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:34.198 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:10:35.237 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:10:40.243 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:10:40.244 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:10:40.244 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:40.244 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:10:40.244 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:40.244 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:10:40.244 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:10:40.245 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:40.245 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:10:40.245 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:40.245 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:40.245 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:10:40.245 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:44.244 7fc3aa63fe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:10:49.249 7fc3aa63fe10 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:10:49.249 7fc3aa63fe10 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:10:49.250 7fc3aa63fe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:49.250 7fc3aa63fe10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:10:49.250 7fc3aa63fe10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:49.250 7fc3aa63fe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:10:49.250 7fc3aa63fe10 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:10:49.251 7fc3aa63fe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:49.251 7fc3aa63fe10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:10:49.251 7fc3aa63fe10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:49.251 7fc3aa63fe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:49.251 7fc3aa63fe10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:10:49.251 7fc3aa63fe10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:53.253 7fc3aa63fe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:10:58.260 7fc3aa63fe10 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:10:58.260 7fc3aa63fe10 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:10:58.260 7fc3aa63fe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:58.260 7fc3aa63fe10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:10:58.260 7fc3aa63fe10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:58.260 7fc3aa63fe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:10:58.261 7fc3aa63fe10 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:10:58.261 7fc3aa63fe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:58.261 7fc3aa63fe10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:10:58.261 7fc3aa63fe10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:58.261 7fc3aa63fe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:58.261 7fc3aa63fe10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:10:58.261 7fc3aa63fe10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:02.261 7fc3aceb06d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:11:05.468 7fc3accdb2e8 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:11:07.263 7fc3aceb06d8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:11:07.263 7fc3aceb06d8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:11:07.263 7fc3aceb06d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:07.263 7fc3aceb06d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:11:07.263 7fc3aceb06d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:07.263 7fc3aceb06d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:11:07.264 7fc3aceb06d8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:11:07.264 7fc3aceb06d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:07.264 7fc3aceb06d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:11:07.264 7fc3aceb06d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:07.264 7fc3aceb06d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:07.264 7fc3aceb06d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:11:07.264 7fc3aceb06d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:11.263 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:11:15.698 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51297196, partition_space_available_1k=29793288, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82756, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74612, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=41968, cpu_share=0.01, mem_res=39624, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15100820, free=11143944, buffers=991572, cached=5428784, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.18, five_min_avg=6.75, fifteen_min_avg=4.54, cpu_share=3.12, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:11:16.265 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:11:16.265 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:11:16.265 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:16.266 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:11:16.266 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:16.266 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:16.266 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51297196 partition_space_available_1k = 29793288 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 82756 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 74612 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 41968 cpu_share = 0.01 mem_res = 39624 >> } system_mem_usage = << total = 32665120 used = 15100820 free = 11143944 buffers = 991572 cached = 5428784 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 4.18 five_min_avg = 6.75 fifteen_min_avg = 4.54 cpu_share = 3.12 node_type = analytics-snmp-node >> >> 06/02/2025 02:11:16.266 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:16.266 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:11:16.266 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:11:16.267 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:16.267 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:11:16.267 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:16.267 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:16.267 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:11:16.267 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:20.269 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:11:25.275 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:11:25.275 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:11:25.275 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:25.275 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:11:25.275 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:25.276 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:11:25.276 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:11:25.276 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:25.276 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:11:25.276 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:25.277 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:25.277 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:11:25.277 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:29.278 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:11:34.285 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:11:34.285 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:11:34.285 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:34.286 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:11:34.286 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:34.286 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:11:34.288 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:11:34.288 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:34.289 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:11:34.289 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:34.289 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:34.289 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:11:34.289 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:38.288 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:11:43.293 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:11:43.293 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:11:43.293 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:43.293 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:11:43.293 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:43.293 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:11:43.293 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:11:43.294 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:43.294 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:11:43.294 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:43.294 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:43.294 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:11:43.294 7fc3aaa8c828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:47.295 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:11:52.302 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:11:52.303 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:11:52.303 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:52.303 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:11:52.305 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:52.305 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:11:52.305 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:11:52.306 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:52.307 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:11:52.307 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:52.307 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:52.307 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:11:52.309 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:55.823 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:11:56.304 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:12:01.308 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:12:01.308 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:12:01.309 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:01.309 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:12:01.309 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:01.309 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:12:01.309 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:12:01.309 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:01.309 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:12:01.310 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:01.310 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:01.310 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:12:01.310 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:05.312 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:12:10.314 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:12:10.315 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:12:10.315 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:10.315 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:12:10.315 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:10.315 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:12:10.318 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:12:10.318 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:10.318 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:12:10.318 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:10.318 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:10.319 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:12:10.319 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:14.319 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:12:15.731 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51304756, partition_space_available_1k=29785728, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82784, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74640, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=41988, cpu_share=0.01, mem_res=39624, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15488624, free=9661184, buffers=991980, cached=6523332, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.31, five_min_avg=6.71, fifteen_min_avg=4.66, cpu_share=4.0, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:12:19.325 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:12:19.325 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:12:19.325 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:19.326 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:12:19.326 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:19.326 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:19.326 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51304756 partition_space_available_1k = 29785728 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 82784 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 74640 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 41988 cpu_share = 0.01 mem_res = 39624 >> } system_mem_usage = << total = 32665120 used = 15488624 free = 9661184 buffers = 991980 cached = 6523332 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 6.31 five_min_avg = 6.71 fifteen_min_avg = 4.66 cpu_share = 4.0 node_type = analytics-snmp-node >> >> 06/02/2025 02:12:19.326 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:19.326 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:12:19.327 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:12:19.327 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:19.327 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:12:19.327 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:19.327 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:19.327 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:12:19.327 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:23.330 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:12:28.334 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:12:28.334 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:12:28.334 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:28.335 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:12:28.335 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:28.335 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:12:28.335 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:12:28.335 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:28.335 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:12:28.335 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:28.335 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:28.336 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:12:28.336 7fc3a9dd4c18 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:32.337 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:12:37.343 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:12:37.343 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:12:37.343 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:37.343 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:12:37.343 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:37.343 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:12:37.344 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:12:37.344 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:37.344 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:12:37.344 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:37.344 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:37.344 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:12:37.345 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:41.347 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:12:46.350 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:12:46.350 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:12:46.350 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:46.350 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:12:46.351 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:46.351 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:12:46.351 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:12:46.351 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:46.351 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:12:46.351 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:46.351 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:46.352 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:12:46.352 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:50.354 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:12:55.360 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:12:55.360 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:12:55.360 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:55.360 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:12:55.360 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:55.360 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:12:55.361 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:12:55.361 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:55.361 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:12:55.361 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:55.361 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:55.361 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:12:55.361 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:59.364 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:13:04.369 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:13:04.369 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:13:04.369 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:04.369 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:13:04.369 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:04.369 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:13:04.369 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:13:04.370 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:04.370 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:13:04.370 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:04.370 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:04.370 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:13:04.370 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:08.373 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:13:13.376 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:13:13.376 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:13:13.376 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:13.377 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:13:13.377 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:13.377 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:13:13.377 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:13:13.377 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:13.378 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:13:13.378 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:13.378 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:13.378 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:13:13.378 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:15.689 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51317024, partition_space_available_1k=29773460, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82780, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74636, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=41996, cpu_share=0.01, mem_res=39624, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15139508, free=9732304, buffers=991988, cached=6801320, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.18, five_min_avg=6.48, fifteen_min_avg=4.72, cpu_share=4.0, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:13:15.690 7fc3a9dcf4e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:15.690 7fc3a9dcf4e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51317024 partition_space_available_1k = 29773460 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 82780 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 74636 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 41996 cpu_share = 0.01 mem_res = 39624 >> } system_mem_usage = << total = 32665120 used = 15139508 free = 9732304 buffers = 991988 cached = 6801320 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 5.18 five_min_avg = 6.48 fifteen_min_avg = 4.72 cpu_share = 4.0 node_type = analytics-snmp-node >> >> 06/02/2025 02:13:15.690 7fc3a9dcf4e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:17.377 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:13:22.384 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:13:22.384 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:13:22.384 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:22.384 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:13:22.384 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:22.385 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:13:22.385 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:13:22.385 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:22.385 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:13:22.385 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:22.385 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:22.385 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:13:22.385 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:26.385 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:13:31.387 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:13:31.387 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:13:31.388 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:31.388 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:13:31.388 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:31.388 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:13:31.388 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:13:31.389 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:31.389 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:13:31.389 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:31.389 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:31.389 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:13:31.389 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:35.390 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:13:40.397 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:13:40.397 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:13:40.397 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:40.397 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:13:40.397 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:40.397 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:13:40.398 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:13:40.398 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:40.398 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:13:40.398 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:40.398 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:40.398 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:13:40.398 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:44.401 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:13:49.405 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:13:49.406 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:13:49.406 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:49.406 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:13:49.406 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:49.406 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:13:49.406 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:13:49.407 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:49.407 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:13:49.407 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:49.407 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:49.407 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:13:49.407 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:53.409 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:13:58.414 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:13:58.414 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:13:58.415 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:58.415 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:13:58.415 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:58.415 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:13:58.415 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:13:58.415 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:58.415 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:13:58.416 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:58.416 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:58.416 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:13:58.416 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:02.416 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:14:07.422 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:14:07.422 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:14:07.422 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:07.423 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:14:07.423 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:07.423 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:14:07.423 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:14:07.423 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:07.423 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:14:07.423 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:07.423 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:07.424 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:14:07.424 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:11.424 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:14:15.697 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51322392, partition_space_available_1k=29768092, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82836, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74688, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42044, cpu_share=0.01, mem_res=39624, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15159436, free=9705884, buffers=992000, cached=6807800, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.55, five_min_avg=5.8, fifteen_min_avg=4.59, cpu_share=2.75, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:14:16.426 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:14:16.426 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:14:16.426 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:16.426 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:14:16.426 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:16.427 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:16.427 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51322392 partition_space_available_1k = 29768092 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 82836 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 74688 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42044 cpu_share = 0.01 mem_res = 39624 >> } system_mem_usage = << total = 32665120 used = 15159436 free = 9705884 buffers = 992000 cached = 6807800 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 3.55 five_min_avg = 5.8 fifteen_min_avg = 4.59 cpu_share = 2.75 node_type = analytics-snmp-node >> >> 06/02/2025 02:14:16.427 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:16.427 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:14:16.427 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:14:16.427 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:16.428 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:14:16.428 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:16.428 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:16.428 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:14:16.428 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:20.430 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:14:25.434 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:14:25.435 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:14:25.435 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:25.435 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:14:25.435 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:25.435 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:14:25.436 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:14:25.436 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:25.436 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:14:25.436 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:25.436 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:25.436 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:14:25.436 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:29.438 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:14:34.442 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:14:34.443 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:14:34.443 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:34.443 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:14:34.443 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:34.443 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:14:34.443 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:14:34.444 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:34.444 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:14:34.444 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:34.444 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:34.444 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:14:34.444 7fc3aa628828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:38.445 7fc3a9dc5780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:14:43.449 7fc3a9dc5780 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:14:43.449 7fc3a9dc5780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:14:43.450 7fc3a9dc5780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:43.450 7fc3a9dc5780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:14:43.450 7fc3a9dc5780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:43.450 7fc3a9dc5780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:14:43.450 7fc3a9dc5780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:14:43.450 7fc3a9dc5780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:43.451 7fc3a9dc5780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:14:43.451 7fc3a9dc5780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:43.451 7fc3a9dc5780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:43.451 7fc3a9dc5780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:14:43.451 7fc3a9dc5780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:47.450 7fc3a9e036d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:14:52.456 7fc3a9e036d8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:14:52.456 7fc3a9e036d8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:14:52.456 7fc3a9e036d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:52.456 7fc3a9e036d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:14:52.456 7fc3a9e036d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:52.456 7fc3a9e036d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:14:52.457 7fc3a9e036d8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:14:52.457 7fc3a9e036d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:52.457 7fc3a9e036d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:14:52.457 7fc3a9e036d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:52.457 7fc3a9e036d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:52.457 7fc3a9e036d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:14:52.457 7fc3a9e036d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:56.460 7fc3a9e036d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:15:01.466 7fc3a9e036d8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:15:01.466 7fc3a9e036d8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:15:01.467 7fc3a9e036d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:01.467 7fc3a9e036d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:15:01.467 7fc3a9e036d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:01.467 7fc3a9e036d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:15:01.467 7fc3a9e036d8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:15:01.468 7fc3a9e036d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:01.468 7fc3a9e036d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:15:01.468 7fc3a9e036d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:01.468 7fc3a9e036d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:01.468 7fc3a9e036d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:15:01.468 7fc3a9e036d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:05.469 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:15:09.868 7fc3aa611f60 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:15:10.471 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:15:10.472 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:15:10.472 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:10.472 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:15:10.472 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:10.472 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:15:10.473 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:15:10.473 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:10.473 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:15:10.473 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:10.473 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:10.474 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:15:10.474 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:14.472 7fc3aa611f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:15:15.702 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51334164, partition_space_available_1k=29756320, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82860, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74712, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42068, cpu_share=0.01, mem_res=39624, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15253560, free=9592292, buffers=992832, cached=6826436, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.68, five_min_avg=5.11, fifteen_min_avg=4.43, cpu_share=3.12, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:15:19.475 7fc3aa611f60 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:15:19.476 7fc3aa611f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:15:19.476 7fc3aa611f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:19.476 7fc3aa611f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:15:19.476 7fc3aa611f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:19.476 7fc3aa611f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:19.477 7fc3aa611f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51334164 partition_space_available_1k = 29756320 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 82860 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 74712 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42068 cpu_share = 0.01 mem_res = 39624 >> } system_mem_usage = << total = 32665120 used = 15253560 free = 9592292 buffers = 992832 cached = 6826436 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 2.68 five_min_avg = 5.11 fifteen_min_avg = 4.43 cpu_share = 3.12 node_type = analytics-snmp-node >> >> 06/02/2025 02:15:19.477 7fc3aa611f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:19.477 7fc3aa611f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:15:19.477 7fc3aa611f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:15:19.477 7fc3aa611f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:19.477 7fc3aa611f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:15:19.478 7fc3aa611f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:19.478 7fc3aa611f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:19.478 7fc3aa611f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:15:19.478 7fc3aa611f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:20.183 7fc3acea8240 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:15:23.477 7fc3acea8240 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:15:28.483 7fc3acea8240 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:15:28.484 7fc3acea8240 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:15:28.484 7fc3acea8240 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:28.484 7fc3acea8240 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:15:28.484 7fc3acea8240 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:28.484 7fc3acea8240 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:15:28.484 7fc3acea8240 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:15:28.485 7fc3acea8240 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:28.485 7fc3acea8240 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:15:28.485 7fc3acea8240 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:28.485 7fc3acea8240 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:28.485 7fc3acea8240 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:15:28.485 7fc3acea8240 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:30.928 7fc3acea8240 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:15:32.484 7fc3ac7e6978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:15:37.490 7fc3ac7e6978 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:15:37.491 7fc3ac7e6978 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:15:37.491 7fc3ac7e6978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:37.491 7fc3ac7e6978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:15:37.491 7fc3ac7e6978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:37.491 7fc3ac7e6978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:15:37.491 7fc3ac7e6978 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:15:37.492 7fc3ac7e6978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:37.492 7fc3ac7e6978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:15:37.492 7fc3ac7e6978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:37.492 7fc3ac7e6978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:37.492 7fc3ac7e6978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:15:37.492 7fc3ac7e6978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:41.495 7fc3ac7e6978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:15:46.501 7fc3ac7e6978 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:15:46.501 7fc3ac7e6978 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:15:46.501 7fc3ac7e6978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:46.501 7fc3ac7e6978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:15:46.501 7fc3ac7e6978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:46.501 7fc3ac7e6978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:15:46.502 7fc3ac7e6978 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:15:46.502 7fc3ac7e6978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:46.502 7fc3ac7e6978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:15:46.502 7fc3ac7e6978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:46.502 7fc3ac7e6978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:46.502 7fc3ac7e6978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:15:46.502 7fc3ac7e6978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:50.504 7fc3aa6462e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:15:55.509 7fc3aa6462e8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:15:55.509 7fc3aa6462e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:15:55.509 7fc3aa6462e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:55.509 7fc3aa6462e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:15:55.509 7fc3aa6462e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:55.509 7fc3aa6462e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:15:55.510 7fc3aa6462e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:15:55.510 7fc3aa6462e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:55.510 7fc3aa6462e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:15:55.510 7fc3aa6462e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:55.511 7fc3aa6462e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:55.511 7fc3aa6462e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:15:55.511 7fc3aa6462e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:59.513 7fc3aa6462e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:16:04.517 7fc3aa6462e8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:16:04.517 7fc3aa6462e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:16:04.517 7fc3aa6462e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:04.517 7fc3aa6462e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:16:04.517 7fc3aa6462e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:04.517 7fc3aa6462e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:16:04.518 7fc3aa6462e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:16:04.518 7fc3aa6462e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:04.518 7fc3aa6462e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:16:04.518 7fc3aa6462e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:04.518 7fc3aa6462e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:04.518 7fc3aa6462e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:16:04.518 7fc3aa6462e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:08.521 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:16:13.526 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:16:13.526 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:16:13.526 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:13.526 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:16:13.526 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:13.526 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:16:13.527 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:16:13.527 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:13.527 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:16:13.527 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:13.527 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:13.527 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:16:13.527 7fc3acea8048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:15.714 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51338016, partition_space_available_1k=29752468, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82860, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74704, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42064, cpu_share=0.01, mem_res=39624, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15163620, free=9667704, buffers=993384, cached=6840412, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.43, five_min_avg=4.64, fifteen_min_avg=4.31, cpu_share=3.0, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:16:15.715 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:15.715 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51338016 partition_space_available_1k = 29752468 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 82860 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 74704 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42064 cpu_share = 0.01 mem_res = 39624 >> } system_mem_usage = << total = 32665120 used = 15163620 free = 9667704 buffers = 993384 cached = 6840412 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 2.43 five_min_avg = 4.64 fifteen_min_avg = 4.31 cpu_share = 3.0 node_type = analytics-snmp-node >> >> 06/02/2025 02:16:15.715 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:17.528 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:16:22.535 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:16:22.536 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:16:22.536 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:22.536 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:16:22.536 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:22.536 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:16:22.537 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:16:22.537 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:22.537 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:16:22.537 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:22.537 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:22.537 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:16:22.537 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:26.539 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:16:31.545 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:16:31.545 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:16:31.546 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:31.546 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:16:31.546 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:31.546 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:16:31.546 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:16:31.547 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:31.547 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:16:31.547 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:31.547 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:31.547 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:16:31.547 7fc3a9dcfcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:35.548 7fc3a9db5048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:16:40.555 7fc3a9db5048 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:16:40.556 7fc3a9db5048 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:16:40.556 7fc3a9db5048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:40.556 7fc3a9db5048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:16:40.556 7fc3a9db5048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:40.556 7fc3a9db5048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:16:40.557 7fc3a9db5048 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:16:40.557 7fc3a9db5048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:40.557 7fc3a9db5048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:16:40.557 7fc3a9db5048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:40.557 7fc3a9db5048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:40.557 7fc3a9db5048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:16:40.557 7fc3a9db5048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:44.557 7fc3a9db5048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:16:49.560 7fc3a9db5048 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:16:49.561 7fc3a9db5048 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:16:49.561 7fc3a9db5048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:49.561 7fc3a9db5048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:16:49.561 7fc3a9db5048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:49.561 7fc3a9db5048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:16:49.561 7fc3a9db5048 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:16:49.561 7fc3a9db5048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:49.561 7fc3a9db5048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:16:49.561 7fc3a9db5048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:49.562 7fc3a9db5048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:49.562 7fc3a9db5048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:16:49.562 7fc3a9db5048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:53.564 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:16:54.572 7fc3a9dcc588 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:16:58.569 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:16:58.569 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:16:58.569 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:58.569 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:16:58.569 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:58.569 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:16:58.570 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:16:58.570 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:58.570 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:16:58.570 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:58.570 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:58.570 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:16:58.570 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:02.572 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:17:07.577 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:17:07.578 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:17:07.578 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:07.578 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:17:07.578 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:07.578 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:17:07.578 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:17:07.579 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:07.579 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:17:07.579 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:07.579 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:07.579 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:17:07.579 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:11.579 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:17:15.707 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51351388, partition_space_available_1k=29739096, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82912, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74760, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42112, cpu_share=0.01, mem_res=39624, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15185476, free=9603868, buffers=994116, cached=6881660, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.71, five_min_avg=5.1, fifteen_min_avg=4.5, cpu_share=5.12, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:17:16.582 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:17:16.582 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:17:16.583 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:16.583 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:17:16.583 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:16.583 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:16.583 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51351388 partition_space_available_1k = 29739096 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 82912 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 74760 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42112 cpu_share = 0.01 mem_res = 39624 >> } system_mem_usage = << total = 32665120 used = 15185476 free = 9603868 buffers = 994116 cached = 6881660 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 4.71 five_min_avg = 5.1 fifteen_min_avg = 4.5 cpu_share = 5.12 node_type = analytics-snmp-node >> >> 06/02/2025 02:17:16.583 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:16.583 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:17:16.584 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:17:16.584 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:16.584 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:17:16.584 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:16.584 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:16.584 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:17:16.585 7fc3a9e03b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:20.585 7fc3acce4438 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:17:25.589 7fc3acce4438 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:17:25.589 7fc3acce4438 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:17:25.589 7fc3acce4438 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:25.589 7fc3acce4438 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:17:25.589 7fc3acce4438 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:25.589 7fc3acce4438 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:17:25.590 7fc3acce4438 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:17:25.590 7fc3acce4438 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:25.590 7fc3acce4438 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:17:25.590 7fc3acce4438 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:25.591 7fc3acce4438 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:25.591 7fc3acce4438 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:17:25.591 7fc3acce4438 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:29.593 7fc3acce4438 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:17:34.597 7fc3acce4438 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:17:34.597 7fc3acce4438 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:17:34.598 7fc3acce4438 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:34.598 7fc3acce4438 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:17:34.598 7fc3acce4438 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:34.598 7fc3acce4438 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:17:34.598 7fc3acce4438 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:17:34.598 7fc3acce4438 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:34.599 7fc3acce4438 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:17:34.599 7fc3acce4438 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:34.599 7fc3acce4438 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:34.599 7fc3acce4438 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:17:34.599 7fc3acce4438 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:38.602 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:17:43.607 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:17:43.608 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:17:43.608 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:43.608 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:17:43.608 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:43.608 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:17:43.610 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:17:43.610 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:43.610 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:17:43.611 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:43.611 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:43.611 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:17:43.611 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:47.610 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:17:52.616 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:17:52.616 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:17:52.616 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:52.616 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:17:52.616 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:52.616 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:17:52.617 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:17:52.617 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:52.617 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:17:52.617 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:52.617 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:52.617 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:17:52.617 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:56.617 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:18:01.623 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:18:01.624 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:18:01.624 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:01.625 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:18:01.625 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:01.625 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:18:01.626 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:18:01.626 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:01.626 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:18:01.627 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:01.627 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:01.627 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:18:01.627 7fc3acc50b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:05.624 7fc3a9dccac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:18:10.627 7fc3a9dccac8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:18:10.627 7fc3a9dccac8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:18:10.627 7fc3a9dccac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:10.627 7fc3a9dccac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:18:10.628 7fc3a9dccac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:10.628 7fc3a9dccac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:18:10.628 7fc3a9dccac8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:18:10.628 7fc3a9dccac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:10.629 7fc3a9dccac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:18:10.629 7fc3a9dccac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:10.629 7fc3a9dccac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:10.629 7fc3a9dccac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:18:10.629 7fc3a9dccac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:14.628 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:18:15.711 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51357580, partition_space_available_1k=29732904, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82940, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74784, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42140, cpu_share=0.01, mem_res=39624, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15213972, free=9567832, buffers=994116, cached=6889200, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.94, five_min_avg=4.53, fifteen_min_avg=4.34, cpu_share=2.62, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:18:19.631 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:18:19.632 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:18:19.632 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:19.632 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:18:19.632 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:19.632 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:19.632 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51357580 partition_space_available_1k = 29732904 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 82940 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 74784 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42140 cpu_share = 0.01 mem_res = 39624 >> } system_mem_usage = << total = 32665120 used = 15213972 free = 9567832 buffers = 994116 cached = 6889200 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 2.94 five_min_avg = 4.53 fifteen_min_avg = 4.34 cpu_share = 2.62 node_type = analytics-snmp-node >> >> 06/02/2025 02:18:19.632 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:19.632 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:18:19.633 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:18:19.633 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:19.633 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:18:19.633 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:19.633 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:19.633 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:18:19.633 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:23.635 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:18:28.643 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:18:28.643 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:18:28.643 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:28.643 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:18:28.643 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:28.643 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:18:28.644 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:18:28.644 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:28.644 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:18:28.644 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:28.644 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:28.644 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:18:28.644 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:32.645 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:18:37.650 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:18:37.650 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:18:37.650 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:37.650 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:18:37.650 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:37.650 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:18:37.651 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:18:37.651 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:37.651 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:18:37.651 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:37.651 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:37.651 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:18:37.651 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:41.654 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:18:46.661 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:18:46.661 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:18:46.661 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:46.661 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:18:46.661 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:46.661 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:18:46.662 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:18:46.662 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:46.662 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:18:46.662 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:46.662 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:46.662 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:18:46.662 7fc3aaa88eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:50.661 7fc3acce5198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:18:55.667 7fc3acce5198 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:18:55.667 7fc3acce5198 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:18:55.667 7fc3acce5198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:55.667 7fc3acce5198 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:18:55.667 7fc3acce5198 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:55.668 7fc3acce5198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:18:55.668 7fc3acce5198 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:18:55.668 7fc3acce5198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:55.669 7fc3acce5198 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:18:55.669 7fc3acce5198 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:55.669 7fc3acce5198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:55.669 7fc3acce5198 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:18:55.669 7fc3acce5198 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:59.670 7fc3acce5198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:19:04.673 7fc3acce5198 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:19:04.673 7fc3acce5198 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:19:04.673 7fc3acce5198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:04.674 7fc3acce5198 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:19:04.674 7fc3acce5198 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:04.674 7fc3acce5198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:19:04.674 7fc3acce5198 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:19:04.675 7fc3acce5198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:04.675 7fc3acce5198 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:19:04.675 7fc3acce5198 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:04.675 7fc3acce5198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:04.675 7fc3acce5198 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:19:04.675 7fc3acce5198 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:08.677 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:19:13.681 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:19:13.682 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:19:13.682 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:13.682 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:19:13.682 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:13.682 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:19:13.683 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:19:13.683 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:13.683 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:19:13.683 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:13.683 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:13.683 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:19:13.683 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:15.711 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51362976, partition_space_available_1k=29727508, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82936, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74780, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42136, cpu_share=0.01, mem_res=39624, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15192376, free=9582940, buffers=994124, cached=6895680, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.4, five_min_avg=4.1, fifteen_min_avg=4.2, cpu_share=2.75, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:19:15.712 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:15.712 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51362976 partition_space_available_1k = 29727508 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 82936 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 74780 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42136 cpu_share = 0.01 mem_res = 39624 >> } system_mem_usage = << total = 32665120 used = 15192376 free = 9582940 buffers = 994124 cached = 6895680 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 2.4 five_min_avg = 4.1 fifteen_min_avg = 4.2 cpu_share = 2.75 node_type = analytics-snmp-node >> >> 06/02/2025 02:19:15.712 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:17.682 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:19:22.687 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:19:22.687 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:19:22.687 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:22.687 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:19:22.687 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:22.687 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:19:22.688 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:19:22.688 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:22.688 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:19:22.688 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:22.688 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:22.688 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:19:22.688 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:26.689 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:19:31.693 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:19:31.693 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:19:31.693 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:31.693 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:19:31.694 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:31.694 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:19:31.694 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:19:31.695 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:31.695 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:19:31.695 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:31.695 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:31.695 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:19:31.695 7fc3ae323ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:35.694 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:19:40.701 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:19:40.701 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:19:40.701 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:40.701 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:19:40.701 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:40.701 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:19:40.702 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:19:40.702 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:40.702 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:19:40.702 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:40.702 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:40.702 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:19:40.702 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:44.705 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:19:49.707 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:19:49.707 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:19:49.707 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:49.707 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:19:49.707 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:49.708 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:19:49.708 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:19:49.708 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:49.708 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:19:49.709 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:49.709 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:49.709 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:19:49.709 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:53.711 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:19:58.717 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:19:58.717 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:19:58.717 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:58.717 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:19:58.717 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:58.718 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:19:58.718 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:19:58.718 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:58.718 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:19:58.718 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:58.718 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:58.719 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:19:58.719 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:02.719 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:20:07.723 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:20:07.723 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:20:07.723 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:07.723 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:20:07.723 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:07.723 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:20:07.724 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:20:07.724 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:07.724 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:20:07.724 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:07.724 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:07.724 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:20:07.724 7fc3ae336d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:11.724 7fc3aa63f0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:20:15.710 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51368524, partition_space_available_1k=29721960, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82988, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74832, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42184, cpu_share=0.01, mem_res=39624, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15264868, free=9501528, buffers=994328, cached=6904396, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.31, five_min_avg=3.77, fifteen_min_avg=4.08, cpu_share=2.75, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:20:16.727 7fc3aa63f0f0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:20:16.727 7fc3aa63f0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:20:16.727 7fc3aa63f0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:16.727 7fc3aa63f0f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:20:16.727 7fc3aa63f0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:16.728 7fc3aa63f0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:16.728 7fc3aa63f0f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51368524 partition_space_available_1k = 29721960 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 82988 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 74832 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42184 cpu_share = 0.01 mem_res = 39624 >> } system_mem_usage = << total = 32665120 used = 15264868 free = 9501528 buffers = 994328 cached = 6904396 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 2.31 five_min_avg = 3.77 fifteen_min_avg = 4.08 cpu_share = 2.75 node_type = analytics-snmp-node >> >> 06/02/2025 02:20:16.728 7fc3aa63f0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:16.728 7fc3aa63f0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:20:16.729 7fc3aa63f0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:20:16.729 7fc3aa63f0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:16.729 7fc3aa63f0f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:20:16.729 7fc3aa63f0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:16.729 7fc3aa63f0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:16.729 7fc3aa63f0f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:20:16.729 7fc3aa63f0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:20.728 7fc3a9de5978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:20:22.265 7fc3aa6b0780 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:20:25.733 7fc3a9de5978 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:20:25.733 7fc3a9de5978 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:20:25.733 7fc3a9de5978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:25.733 7fc3a9de5978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:20:25.733 7fc3a9de5978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:25.733 7fc3a9de5978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:20:25.734 7fc3a9de5978 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:20:25.734 7fc3a9de5978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:25.734 7fc3a9de5978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:20:25.734 7fc3a9de5978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:25.734 7fc3a9de5978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:25.734 7fc3a9de5978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:20:25.734 7fc3a9de5978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:29.736 7fc3a9de5978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:20:32.990 7fc3aa646a20 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:20:34.739 7fc3a9de5978 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:20:34.739 7fc3a9de5978 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:20:34.740 7fc3a9de5978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:34.740 7fc3a9de5978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:20:34.740 7fc3a9de5978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:34.740 7fc3a9de5978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:20:34.741 7fc3a9de5978 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:20:34.741 7fc3a9de5978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:34.741 7fc3a9de5978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:20:34.741 7fc3a9de5978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:34.741 7fc3a9de5978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:34.741 7fc3a9de5978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:20:34.741 7fc3a9de5978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:38.743 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:20:43.410 7fc3a9e03978 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:20:43.745 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:20:43.745 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:20:43.745 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:43.746 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:20:43.746 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:43.746 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:20:43.746 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:20:43.746 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:43.747 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:20:43.747 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:43.747 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:43.747 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:20:43.747 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:47.748 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:20:52.752 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:20:52.753 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:20:52.753 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:52.753 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:20:52.753 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:52.753 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:20:52.753 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:20:52.753 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:52.753 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:20:52.754 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:52.754 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:52.754 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:20:52.754 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:56.757 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:21:01.763 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:21:01.764 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:21:01.764 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:01.764 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:21:01.764 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:01.764 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:21:01.765 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:21:01.765 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:01.765 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:21:01.765 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:01.765 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:01.765 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:21:01.765 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:05.764 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:21:10.767 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:21:10.767 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:21:10.767 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:10.768 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:21:10.768 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:10.768 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:21:10.768 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:21:10.768 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:10.768 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:21:10.769 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:10.769 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:10.769 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:21:10.769 7fc3a9dd1eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:14.768 7fc3aa6288d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:21:15.728 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51378144, partition_space_available_1k=29712340, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83016, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74856, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42212, cpu_share=0.01, mem_res=39624, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15257708, free=9501948, buffers=995508, cached=6909956, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.13, five_min_avg=3.46, fifteen_min_avg=3.96, cpu_share=3.12, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:21:19.772 7fc3aa6288d0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:21:19.773 7fc3aa6288d0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:21:19.773 7fc3aa6288d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:19.773 7fc3aa6288d0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:21:19.773 7fc3aa6288d0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:19.773 7fc3aa6288d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:19.773 7fc3aa6288d0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51378144 partition_space_available_1k = 29712340 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 83016 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 74856 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42212 cpu_share = 0.01 mem_res = 39624 >> } system_mem_usage = << total = 32665120 used = 15257708 free = 9501948 buffers = 995508 cached = 6909956 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 2.13 five_min_avg = 3.46 fifteen_min_avg = 3.96 cpu_share = 3.12 node_type = analytics-snmp-node >> >> 06/02/2025 02:21:19.773 7fc3aa6288d0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:19.773 7fc3aa6288d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:21:19.774 7fc3aa6288d0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:21:19.774 7fc3aa6288d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:19.774 7fc3aa6288d0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:21:19.774 7fc3aa6288d0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:19.774 7fc3aa6288d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:19.774 7fc3aa6288d0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:21:19.775 7fc3aa6288d0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:23.775 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:21:28.781 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:21:28.781 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:21:28.781 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:28.782 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:21:28.782 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:28.782 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:21:28.782 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:21:28.782 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:28.782 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:21:28.783 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:28.783 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:28.783 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:21:28.783 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:32.785 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:21:37.788 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:21:37.789 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:21:37.789 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:37.789 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:21:37.789 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:37.789 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:21:37.789 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:21:37.789 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:37.790 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:21:37.790 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:37.790 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:37.790 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:21:37.790 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:41.792 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:21:46.798 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:21:46.799 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:21:46.799 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:46.799 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:21:46.799 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:46.799 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:21:46.800 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:21:46.800 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:46.800 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:21:46.800 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:46.800 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:46.800 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:21:46.801 7fc3aa634390 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:50.801 7fc3a9dcc4e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:21:51.973 7fc3aaa886d8 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:21:55.809 7fc3a9dcc4e0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:21:55.809 7fc3a9dcc4e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:21:55.809 7fc3a9dcc4e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:55.809 7fc3a9dcc4e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:21:55.809 7fc3a9dcc4e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:55.809 7fc3a9dcc4e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:21:55.810 7fc3a9dcc4e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:21:55.810 7fc3a9dcc4e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:55.810 7fc3a9dcc4e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:21:55.810 7fc3a9dcc4e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:55.811 7fc3a9dcc4e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:55.811 7fc3a9dcc4e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:21:55.811 7fc3a9dcc4e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:59.813 7fc3aaa886d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:22:04.818 7fc3aaa886d8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:22:04.819 7fc3aaa886d8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:22:04.819 7fc3aaa886d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:04.819 7fc3aaa886d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:22:04.819 7fc3aaa886d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:04.820 7fc3aaa886d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:22:04.820 7fc3aaa886d8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:22:04.820 7fc3aaa886d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:04.820 7fc3aaa886d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:22:04.821 7fc3aaa886d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:04.821 7fc3aaa886d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:04.821 7fc3aaa886d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:22:04.821 7fc3aaa886d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:08.821 7fc3aa634d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:22:13.822 7fc3aa634d68 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:22:13.823 7fc3aa634d68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:22:13.823 7fc3aa634d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:13.823 7fc3aa634d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:22:13.823 7fc3aa634d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:13.823 7fc3aa634d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:22:13.824 7fc3aa634d68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:22:13.824 7fc3aa634d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:13.824 7fc3aa634d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:22:13.825 7fc3aa634d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:13.825 7fc3aa634d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:13.825 7fc3aa634d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:22:13.825 7fc3aa634d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:15.719 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51387092, partition_space_available_1k=29703392, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83012, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74848, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42204, cpu_share=0.01, mem_res=39624, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15268704, free=9466460, buffers=996092, cached=6933864, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.56, five_min_avg=4.21, fifteen_min_avg=4.2, cpu_share=4.88, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:22:15.720 7fc3accba0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:15.720 7fc3accba0f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51387092 partition_space_available_1k = 29703392 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 83012 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 74848 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42204 cpu_share = 0.01 mem_res = 39624 >> } system_mem_usage = << total = 32665120 used = 15268704 free = 9466460 buffers = 996092 cached = 6933864 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 4.56 five_min_avg = 4.21 fifteen_min_avg = 4.2 cpu_share = 4.88 node_type = analytics-snmp-node >> >> 06/02/2025 02:22:15.720 7fc3accba0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:17.825 7fc3acce2f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:22:22.831 7fc3acce2f60 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:22:22.831 7fc3acce2f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:22:22.831 7fc3acce2f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:22.832 7fc3acce2f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:22:22.832 7fc3acce2f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:22.832 7fc3acce2f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:22:22.832 7fc3acce2f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:22:22.832 7fc3acce2f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:22.832 7fc3acce2f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:22:22.833 7fc3acce2f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:22.833 7fc3acce2f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:22.833 7fc3acce2f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:22:22.833 7fc3acce2f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:26.835 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:22:31.841 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:22:31.841 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:22:31.842 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:31.842 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:22:31.842 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:31.842 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:22:31.842 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:22:31.842 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:31.843 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:22:31.843 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:31.843 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:31.843 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:22:31.843 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:35.846 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:22:40.853 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:22:40.853 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:22:40.853 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:40.853 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:22:40.853 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:40.853 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:22:40.854 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:22:40.854 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:40.854 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:22:40.854 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:40.854 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:40.855 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:22:40.855 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:44.856 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:22:49.863 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:22:49.863 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:22:49.863 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:49.863 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:22:49.863 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:49.863 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:22:49.864 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:22:49.864 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:49.864 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:22:49.864 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:49.864 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:49.864 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:22:49.864 7fc3accbab70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:53.865 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:22:58.871 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:22:58.871 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:22:58.872 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:58.872 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:22:58.872 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:58.872 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:22:58.872 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:22:58.873 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:58.873 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:22:58.873 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:58.873 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:58.873 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:22:58.873 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:02.874 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:23:07.877 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:23:07.877 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:23:07.877 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:07.877 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:23:07.877 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:07.877 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:23:07.878 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:23:07.878 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:07.878 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:23:07.878 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:07.878 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:07.878 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:23:07.878 7fc3a9dff390 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:11.877 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:23:15.719 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51392972, partition_space_available_1k=29697512, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83068, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74904, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42264, cpu_share=0.01, mem_res=39624, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15280368, free=9447404, buffers=996100, cached=6941248, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.91, five_min_avg=3.86, fifteen_min_avg=4.09, cpu_share=2.38, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:23:16.881 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:23:16.881 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:23:16.882 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:16.882 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:23:16.882 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:16.882 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:16.882 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51392972 partition_space_available_1k = 29697512 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 83068 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 74904 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42264 cpu_share = 0.01 mem_res = 39624 >> } system_mem_usage = << total = 32665120 used = 15280368 free = 9447404 buffers = 996100 cached = 6941248 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 2.91 five_min_avg = 3.86 fifteen_min_avg = 4.09 cpu_share = 2.38 node_type = analytics-snmp-node >> >> 06/02/2025 02:23:16.882 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:16.882 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:23:16.883 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:23:16.883 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:16.883 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:23:16.883 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:16.883 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:16.883 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:23:16.883 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:20.885 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:23:25.889 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:23:25.889 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:23:25.890 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:25.890 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:23:25.890 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:25.890 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:23:25.890 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:23:25.890 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:25.891 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:23:25.891 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:25.891 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:25.891 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:23:25.891 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:29.893 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:23:34.897 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:23:34.897 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:23:34.897 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:34.897 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:23:34.897 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:34.897 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:23:34.898 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:23:34.898 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:34.898 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:23:34.899 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:34.899 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:34.899 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:23:34.899 7fc3acc3aac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:38.899 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:23:43.906 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:23:43.906 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:23:43.906 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:43.906 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:23:43.906 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:43.906 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:23:43.907 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:23:43.907 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:43.907 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:23:43.907 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:43.907 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:43.907 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:23:43.907 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:47.909 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:23:52.912 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:23:52.912 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:23:52.912 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:52.912 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:23:52.913 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:52.913 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:23:52.913 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:23:52.913 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:52.914 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:23:52.914 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:52.914 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:52.914 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:23:52.914 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:56.916 7fc3a9db5438 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:24:01.923 7fc3a9db5438 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:24:01.923 7fc3a9db5438 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:24:01.923 7fc3a9db5438 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:01.923 7fc3a9db5438 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:24:01.923 7fc3a9db5438 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:01.923 7fc3a9db5438 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:24:01.924 7fc3a9db5438 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:24:01.924 7fc3a9db5438 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:01.924 7fc3a9db5438 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:24:01.924 7fc3a9db5438 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:01.924 7fc3a9db5438 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:01.924 7fc3a9db5438 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:24:01.924 7fc3a9db5438 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:05.926 7fc3a9db5438 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:24:10.929 7fc3a9db5438 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:24:10.929 7fc3a9db5438 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:24:10.929 7fc3a9db5438 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:10.930 7fc3a9db5438 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:24:10.930 7fc3a9db5438 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:10.930 7fc3a9db5438 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:24:10.930 7fc3a9db5438 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:24:10.931 7fc3a9db5438 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:10.931 7fc3a9db5438 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:24:10.931 7fc3a9db5438 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:10.931 7fc3a9db5438 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:10.931 7fc3a9db5438 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:24:10.931 7fc3a9db5438 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:14.930 7fc3a9de5240 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:24:15.724 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51393496, partition_space_available_1k=29696988, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83092, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74928, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42284, cpu_share=0.01, mem_res=39624, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15262684, free=9463988, buffers=996100, cached=6942348, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.6, five_min_avg=3.63, fifteen_min_avg=3.99, cpu_share=2.25, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:24:19.937 7fc3a9de5240 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:24:19.937 7fc3a9de5240 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:24:19.937 7fc3a9de5240 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:19.937 7fc3a9de5240 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:24:19.938 7fc3a9de5240 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:19.938 7fc3a9de5240 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:19.938 7fc3a9de5240 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51393496 partition_space_available_1k = 29696988 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 83092 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 74928 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42284 cpu_share = 0.01 mem_res = 39624 >> } system_mem_usage = << total = 32665120 used = 15262684 free = 9463988 buffers = 996100 cached = 6942348 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 2.6 five_min_avg = 3.63 fifteen_min_avg = 3.99 cpu_share = 2.25 node_type = analytics-snmp-node >> >> 06/02/2025 02:24:19.938 7fc3a9de5240 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:19.938 7fc3a9de5240 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:24:19.938 7fc3a9de5240 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:24:19.938 7fc3a9de5240 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:19.938 7fc3a9de5240 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:24:19.939 7fc3a9de5240 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:19.939 7fc3a9de5240 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:19.939 7fc3a9de5240 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:24:19.939 7fc3a9de5240 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:23.939 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:24:28.945 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:24:28.946 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:24:28.946 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:28.946 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:24:28.946 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:28.946 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:24:28.946 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:24:28.946 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:28.947 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:24:28.947 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:28.947 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:28.947 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:24:28.947 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:32.950 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:24:37.953 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:24:37.953 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:24:37.953 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:37.953 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:24:37.953 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:37.953 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:24:37.954 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:24:37.954 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:37.954 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:24:37.954 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:37.955 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:37.955 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:24:37.955 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:41.957 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:24:46.962 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:24:46.963 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:24:46.963 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:46.963 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:24:46.963 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:46.963 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:24:46.964 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:24:46.964 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:46.964 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:24:46.964 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:46.964 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:46.964 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:24:46.964 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:50.967 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:24:55.972 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:24:55.972 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:24:55.972 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:55.973 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:24:55.973 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:55.973 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:24:55.973 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:24:55.974 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:55.974 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:24:55.974 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:55.974 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:55.974 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:24:55.974 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:59.977 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:25:04.980 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:25:04.981 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:25:04.981 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:04.981 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:25:04.981 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:04.981 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:25:04.982 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:25:04.982 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:04.982 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:25:04.982 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:04.982 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:04.982 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:25:04.982 7fc3a9dff8d0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:08.983 7fc3a9dcfd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:25:13.985 7fc3a9dcfd68 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:25:13.986 7fc3a9dcfd68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:25:13.986 7fc3a9dcfd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:13.986 7fc3a9dcfd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:25:13.986 7fc3a9dcfd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:13.986 7fc3a9dcfd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:25:13.987 7fc3a9dcfd68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:25:13.987 7fc3a9dcfd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:13.987 7fc3a9dcfd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:25:13.987 7fc3a9dcfd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:13.987 7fc3a9dcfd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:13.988 7fc3a9dcfd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:25:13.988 7fc3a9dcfd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:15.720 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51394124, partition_space_available_1k=29696360, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83088, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74924, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42276, cpu_share=0.01, mem_res=39624, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15248952, free=9475584, buffers=996100, cached=6944484, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.04, five_min_avg=3.27, fifteen_min_avg=3.85, cpu_share=2.5, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:25:15.720 7fc3aa628b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:15.721 7fc3aa628b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51394124 partition_space_available_1k = 29696360 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 83088 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 74924 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42276 cpu_share = 0.01 mem_res = 39624 >> } system_mem_usage = << total = 32665120 used = 15248952 free = 9475584 buffers = 996100 cached = 6944484 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 2.04 five_min_avg = 3.27 fifteen_min_avg = 3.85 cpu_share = 2.5 node_type = analytics-snmp-node >> >> 06/02/2025 02:25:15.721 7fc3aa628b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:17.987 7fc3aa628b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:25:22.989 7fc3aa628b70 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:25:22.989 7fc3aa628b70 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:25:22.990 7fc3aa628b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:22.990 7fc3aa628b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:25:22.990 7fc3aa628b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:22.990 7fc3aa628b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:25:22.991 7fc3aa628b70 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:25:22.991 7fc3aa628b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:22.991 7fc3aa628b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:25:22.991 7fc3aa628b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:22.991 7fc3aa628b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:22.991 7fc3aa628b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:25:22.991 7fc3aa628b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:26.993 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:25:32.000 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:25:32.000 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:25:32.000 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:32.000 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:25:32.000 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:32.001 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:25:32.001 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:25:32.001 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:32.001 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:25:32.002 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:32.002 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:32.002 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:25:32.002 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:36.004 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:25:41.012 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:25:41.012 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:25:41.012 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:41.012 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:25:41.013 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:41.013 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:25:41.013 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:25:41.013 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:41.013 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:25:41.013 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:41.013 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:41.013 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:25:41.013 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:45.017 7fc3b30cfe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:25:50.022 7fc3b30cfe10 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:25:50.023 7fc3b30cfe10 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:25:50.023 7fc3b30cfe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:50.023 7fc3b30cfe10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:25:50.023 7fc3b30cfe10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:50.023 7fc3b30cfe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:25:50.023 7fc3b30cfe10 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:25:50.024 7fc3b30cfe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:50.024 7fc3b30cfe10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:25:50.024 7fc3b30cfe10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:50.024 7fc3b30cfe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:50.024 7fc3b30cfe10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:25:50.024 7fc3b30cfe10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:54.023 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:25:59.029 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:25:59.029 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:25:59.029 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:59.029 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:25:59.030 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:59.030 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:25:59.031 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:25:59.031 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:59.031 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:25:59.031 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:59.031 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:59.031 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:25:59.031 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:03.033 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:26:08.039 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:26:08.039 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:26:08.039 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:08.039 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:26:08.039 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:08.039 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:26:08.040 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:26:08.040 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:08.040 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:26:08.040 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:08.040 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:08.040 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:26:08.040 7fc3ace6e630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:12.040 7fc3a9db8cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:26:14.228 7fc3a9db84e0 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:26:15.741 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51412820, partition_space_available_1k=29677664, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83140, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74976, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42328, cpu_share=0.01, mem_res=39624, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15339552, free=9452916, buffers=996124, cached=6876528, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.02, five_min_avg=3.95, fifteen_min_avg=4.04, cpu_share=5.0, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:26:17.044 7fc3a9db8cc0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:26:17.044 7fc3a9db8cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:26:17.044 7fc3a9db8cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:17.044 7fc3a9db8cc0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:26:17.044 7fc3a9db8cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:17.044 7fc3a9db8cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:17.045 7fc3a9db8cc0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51412820 partition_space_available_1k = 29677664 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 83140 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 74976 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42328 cpu_share = 0.01 mem_res = 39624 >> } system_mem_usage = << total = 32665120 used = 15339552 free = 9452916 buffers = 996124 cached = 6876528 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 5.02 five_min_avg = 3.95 fifteen_min_avg = 4.04 cpu_share = 5.0 node_type = analytics-snmp-node >> >> 06/02/2025 02:26:17.045 7fc3a9db8cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:17.045 7fc3a9db8cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:26:17.045 7fc3a9db8cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:26:17.045 7fc3a9db8cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:17.046 7fc3a9db8cc0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:26:17.046 7fc3a9db8cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:17.046 7fc3a9db8cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:17.046 7fc3a9db8cc0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:26:17.046 7fc3a9db8cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:21.044 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:26:24.531 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:26:26.047 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:26:26.048 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:26:26.048 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:26.048 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:26:26.048 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:26.048 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:26:26.048 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:26:26.048 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:26.049 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:26:26.049 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:26.049 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:26.049 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:26:26.049 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:30.052 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:26:35.057 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:26:35.057 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:26:35.057 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:35.058 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:26:35.058 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:35.058 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:26:35.058 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:26:35.058 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:35.059 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:26:35.059 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:35.059 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:35.059 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:26:35.059 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:35.065 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:26:39.060 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:26:44.067 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:26:44.067 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:26:44.067 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:44.067 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:26:44.067 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:44.067 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:26:44.068 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:26:44.068 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:44.068 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:26:44.068 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:44.068 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:44.068 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:26:44.068 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:48.071 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:26:53.078 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:26:53.078 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:26:53.078 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:53.078 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:26:53.078 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:53.078 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:26:53.079 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:26:53.079 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:53.079 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:26:53.079 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:53.079 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:53.080 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:26:53.080 7fc3b204c780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:57.080 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:27:02.086 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:27:02.087 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:27:02.087 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:02.087 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:27:02.087 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:02.087 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:27:02.087 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:27:02.087 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:02.088 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:27:02.088 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:02.088 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:02.088 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:27:02.088 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:06.091 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:27:11.094 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:27:11.094 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:27:11.094 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:11.095 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:27:11.095 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:11.095 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:27:11.095 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:27:11.095 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:11.096 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:27:11.096 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:11.096 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:11.096 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:27:11.096 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:15.096 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:27:15.730 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51411904, partition_space_available_1k=29678580, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83168, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=75000, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42352, cpu_share=0.01, mem_res=39624, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15311924, free=9475136, buffers=996144, cached=6881916, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.26, five_min_avg=3.69, fifteen_min_avg=3.95, cpu_share=2.75, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:27:20.101 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:27:20.101 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:27:20.102 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:20.102 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:27:20.102 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:20.102 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:20.102 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51411904 partition_space_available_1k = 29678580 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 83168 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 75000 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42352 cpu_share = 0.01 mem_res = 39624 >> } system_mem_usage = << total = 32665120 used = 15311924 free = 9475136 buffers = 996144 cached = 6881916 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 3.26 five_min_avg = 3.69 fifteen_min_avg = 3.95 cpu_share = 2.75 node_type = analytics-snmp-node >> >> 06/02/2025 02:27:20.102 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:20.102 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:27:20.103 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:27:20.103 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:20.103 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:27:20.103 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:20.103 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:20.103 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:27:20.103 7fc3accd0d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:24.105 7fc3a9dc5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:27:29.111 7fc3a9dc5eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:27:29.111 7fc3a9dc5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:27:29.112 7fc3a9dc5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:29.112 7fc3a9dc5eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:27:29.112 7fc3a9dc5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:29.112 7fc3a9dc5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:27:29.112 7fc3a9dc5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:27:29.113 7fc3a9dc5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:29.113 7fc3a9dc5eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:27:29.113 7fc3a9dc5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:29.113 7fc3a9dc5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:29.113 7fc3a9dc5eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:27:29.113 7fc3a9dc5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:33.115 7fc3ad819c18 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:27:38.122 7fc3ad819c18 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:27:38.122 7fc3ad819c18 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:27:38.122 7fc3ad819c18 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:38.122 7fc3ad819c18 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:27:38.122 7fc3ad819c18 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:38.122 7fc3ad819c18 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:27:38.123 7fc3ad819c18 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:27:38.123 7fc3ad819c18 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:38.123 7fc3ad819c18 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:27:38.123 7fc3ad819c18 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:38.123 7fc3ad819c18 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:38.123 7fc3ad819c18 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:27:38.123 7fc3ad819c18 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:39.362 7fc3ad819c18 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:27:42.124 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:27:47.130 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:27:47.130 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:27:47.130 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:47.131 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:27:47.131 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:47.131 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:27:47.131 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:27:47.131 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:47.131 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:27:47.131 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:47.132 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:47.132 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:27:47.132 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:51.135 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:27:56.138 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:27:56.138 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:27:56.138 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:56.138 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:27:56.138 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:56.138 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:27:56.139 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:27:56.139 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:56.139 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:27:56.139 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:56.139 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:56.139 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:27:56.139 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:00.141 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:28:05.147 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:28:05.147 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:28:05.148 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:05.148 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:28:05.148 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:05.148 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:28:05.148 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:28:05.148 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:05.149 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:28:05.149 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:05.149 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:05.149 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:28:05.149 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:09.150 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:28:14.153 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:28:14.154 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:28:14.154 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:14.154 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:28:14.154 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:14.154 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:28:14.155 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:28:14.157 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:14.157 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:28:14.157 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:14.157 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:14.157 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:28:14.157 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:15.732 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51413844, partition_space_available_1k=29676640, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83160, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=74996, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42348, cpu_share=0.01, mem_res=39624, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15299772, free=9484056, buffers=996164, cached=6885128, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.99, five_min_avg=3.57, fifteen_min_avg=3.9, cpu_share=2.62, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:28:15.732 7fc3a9db86d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:15.732 7fc3a9db86d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51413844 partition_space_available_1k = 29676640 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 83160 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 74996 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42348 cpu_share = 0.01 mem_res = 39624 >> } system_mem_usage = << total = 32665120 used = 15299772 free = 9484056 buffers = 996164 cached = 6885128 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 2.99 five_min_avg = 3.57 fifteen_min_avg = 3.9 cpu_share = 2.62 node_type = analytics-snmp-node >> >> 06/02/2025 02:28:15.732 7fc3a9db86d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:18.156 7fc3a9db86d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:28:23.162 7fc3a9db86d8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:28:23.162 7fc3a9db86d8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:28:23.163 7fc3a9db86d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:23.163 7fc3a9db86d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:28:23.163 7fc3a9db86d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:23.163 7fc3a9db86d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:28:23.163 7fc3a9db86d8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:28:23.163 7fc3a9db86d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:23.163 7fc3a9db86d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:28:23.163 7fc3a9db86d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:23.164 7fc3a9db86d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:23.164 7fc3a9db86d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:28:23.164 7fc3a9db86d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:27.165 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:28:32.171 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:28:32.171 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:28:32.171 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:32.171 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:28:32.171 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:32.171 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:28:32.172 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:28:32.172 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:32.172 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:28:32.172 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:32.172 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:32.172 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:28:32.172 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:36.175 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:28:41.177 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:28:41.178 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:28:41.178 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:41.178 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:28:41.178 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:41.178 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:28:41.178 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:28:41.179 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:41.179 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:28:41.179 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:41.179 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:41.179 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:28:41.179 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:45.182 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:28:50.187 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:28:50.188 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:28:50.188 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:50.188 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:28:50.189 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:50.189 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:28:50.189 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:28:50.189 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:50.189 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:28:50.189 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:50.189 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:50.190 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:28:50.190 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:54.192 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:28:59.197 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:28:59.197 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:28:59.197 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:59.197 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:28:59.197 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:59.197 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:28:59.198 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:28:59.198 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:59.198 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:28:59.198 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:59.198 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:59.198 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:28:59.198 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:03.200 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:29:08.206 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:29:08.206 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:29:08.206 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:08.206 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:29:08.206 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:08.206 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:29:08.207 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:29:08.207 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:08.207 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:29:08.207 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:08.207 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:08.207 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:29:08.207 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:12.207 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:29:15.732 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51414420, partition_space_available_1k=29676064, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83212, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=75048, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42404, cpu_share=0.01, mem_res=39624, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15288916, free=9493460, buffers=996172, cached=6886572, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.49, five_min_avg=3.31, fifteen_min_avg=3.78, cpu_share=2.62, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:29:17.210 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:29:17.211 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:29:17.211 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:17.211 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:29:17.211 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:17.211 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:17.211 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51414420 partition_space_available_1k = 29676064 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 83212 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 75048 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42404 cpu_share = 0.01 mem_res = 39624 >> } system_mem_usage = << total = 32665120 used = 15288916 free = 9493460 buffers = 996172 cached = 6886572 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 2.49 five_min_avg = 3.31 fifteen_min_avg = 3.78 cpu_share = 2.62 node_type = analytics-snmp-node >> >> 06/02/2025 02:29:17.211 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:17.211 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:29:17.212 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:29:17.212 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:17.212 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:29:17.212 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:17.212 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:17.213 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:29:17.213 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:21.213 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:29:26.216 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:29:26.216 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:29:26.216 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:26.216 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:29:26.216 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:26.216 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:29:26.217 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:29:26.217 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:26.217 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:29:26.217 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:26.217 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:26.217 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:29:26.217 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:30.220 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:29:35.224 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:29:35.225 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:29:35.225 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:35.225 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:29:35.225 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:35.225 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:29:35.226 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:29:35.226 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:35.226 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:29:35.226 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:35.226 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:35.226 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:29:35.226 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:39.229 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:29:44.233 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:29:44.233 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:29:44.233 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:44.233 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:29:44.233 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:44.234 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:29:44.234 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:29:44.234 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:44.234 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:29:44.235 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:44.235 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:44.235 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:29:44.235 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:48.237 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:29:53.243 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:29:53.243 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:29:53.243 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:53.243 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:29:53.243 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:53.243 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:29:53.244 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:29:53.244 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:53.244 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:29:53.244 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:53.244 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:53.244 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:29:53.244 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:57.245 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:30:02.251 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:30:02.251 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:30:02.251 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:02.252 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:30:02.252 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:02.252 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:30:02.253 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:30:02.254 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:02.254 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:30:02.254 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:02.254 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:02.254 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:30:02.255 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:06.254 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:30:11.256 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:30:11.256 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:30:11.256 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:11.257 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:30:11.257 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:11.257 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:30:11.258 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:30:11.258 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:11.258 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:30:11.258 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:11.258 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:11.258 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:30:11.258 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:15.258 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:30:15.731 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51414988, partition_space_available_1k=29675496, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83240, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=75072, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42428, cpu_share=0.01, mem_res=39624, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15281592, free=9478616, buffers=997764, cached=6907148, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.11, five_min_avg=3.05, fifteen_min_avg=3.66, cpu_share=2.62, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:30:20.264 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:30:20.265 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:30:20.265 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:20.265 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:30:20.265 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:20.265 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:20.265 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51414988 partition_space_available_1k = 29675496 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 83240 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 75072 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42428 cpu_share = 0.01 mem_res = 39624 >> } system_mem_usage = << total = 32665120 used = 15281592 free = 9478616 buffers = 997764 cached = 6907148 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 2.11 five_min_avg = 3.05 fifteen_min_avg = 3.66 cpu_share = 2.62 node_type = analytics-snmp-node >> >> 06/02/2025 02:30:20.265 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:20.265 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:30:20.266 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:30:20.266 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:20.266 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:30:20.266 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:20.266 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:20.266 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:30:20.266 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:24.269 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:30:29.274 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:30:29.274 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:30:29.275 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:29.275 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:30:29.275 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:29.275 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:30:29.276 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:30:29.276 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:29.276 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:30:29.276 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:29.276 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:29.276 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:30:29.276 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:33.280 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:30:38.286 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:30:38.286 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:30:38.286 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:38.287 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:30:38.287 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:38.287 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:30:38.287 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:30:38.287 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:38.287 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:30:38.287 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:38.287 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:38.288 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:30:38.288 7fc3a9dd4198 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:42.288 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:30:47.293 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:30:47.294 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:30:47.294 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:47.294 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:30:47.294 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:47.294 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:30:47.295 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:30:47.295 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:47.295 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:30:47.295 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:47.295 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:47.296 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:30:47.296 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:51.298 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:30:56.301 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:30:56.301 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:30:56.301 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:56.301 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:30:56.302 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:56.302 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:30:56.302 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:30:56.303 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:56.303 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:30:56.303 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:56.303 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:56.303 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:30:56.303 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:58.015 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:31:00.301 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:31:05.307 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:31:05.307 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:31:05.307 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:05.307 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:31:05.307 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:05.307 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:31:05.308 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:31:05.308 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:05.308 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:31:05.308 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:05.308 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:05.308 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:31:05.309 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:08.414 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:31:09.307 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:31:14.310 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:31:14.311 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:31:14.311 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:14.311 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:31:14.311 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:14.311 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:31:14.312 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:31:14.312 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:14.312 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:31:14.312 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:14.312 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:14.312 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:31:14.312 7fc3a9dd44e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:15.745 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51428540, partition_space_available_1k=29661944, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83232, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=75068, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42452, cpu_share=0.01, mem_res=39656, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15394084, free=9336260, buffers=997792, cached=6936984, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.05, five_min_avg=3.89, fifteen_min_avg=3.92, cpu_share=5.25, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:31:15.745 7fc3acce24e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:15.745 7fc3acce24e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51428540 partition_space_available_1k = 29661944 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 83232 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 75068 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42452 cpu_share = 0.01 mem_res = 39656 >> } system_mem_usage = << total = 32665120 used = 15394084 free = 9336260 buffers = 997792 cached = 6936984 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 5.05 five_min_avg = 3.89 fifteen_min_avg = 3.92 cpu_share = 5.25 node_type = analytics-snmp-node >> >> 06/02/2025 02:31:15.747 7fc3acce24e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:18.313 7fc3acce24e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:31:18.994 7fc3a9dc5630 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:31:23.319 7fc3acce24e0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:31:23.319 7fc3acce24e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:31:23.319 7fc3acce24e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:23.319 7fc3acce24e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:31:23.319 7fc3acce24e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:23.320 7fc3acce24e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:31:23.320 7fc3acce24e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:31:23.320 7fc3acce24e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:23.320 7fc3acce24e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:31:23.320 7fc3acce24e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:23.320 7fc3acce24e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:23.320 7fc3acce24e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:31:23.320 7fc3acce24e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:27.320 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:31:32.326 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:31:32.326 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:31:32.326 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:32.327 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:31:32.327 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:32.327 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:31:32.327 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:31:32.327 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:32.327 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:31:32.327 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:32.327 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:32.328 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:31:32.328 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:36.329 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:31:41.335 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:31:41.335 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:31:41.335 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:41.335 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:31:41.336 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:41.336 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:31:41.336 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:31:41.336 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:41.336 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:31:41.336 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:41.336 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:41.337 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:31:41.337 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:45.338 7fc3a9dc52e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:31:50.345 7fc3a9dc52e8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:31:50.345 7fc3a9dc52e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:31:50.345 7fc3a9dc52e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:50.345 7fc3a9dc52e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:31:50.345 7fc3a9dc52e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:50.345 7fc3a9dc52e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:31:50.345 7fc3a9dc52e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:31:50.346 7fc3a9dc52e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:50.346 7fc3a9dc52e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:31:50.346 7fc3a9dc52e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:50.346 7fc3a9dc52e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:50.346 7fc3a9dc52e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:31:50.346 7fc3a9dc52e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:54.349 7fc3a9dc52e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:31:59.353 7fc3a9dc52e8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:31:59.353 7fc3a9dc52e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:31:59.353 7fc3a9dc52e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:59.353 7fc3a9dc52e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:31:59.353 7fc3a9dc52e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:59.353 7fc3a9dc52e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:31:59.354 7fc3a9dc52e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:31:59.354 7fc3a9dc52e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:59.354 7fc3a9dc52e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:31:59.354 7fc3a9dc52e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:59.354 7fc3a9dc52e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:59.354 7fc3a9dc52e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:31:59.354 7fc3a9dc52e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:03.357 7fc3accb8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:32:08.364 7fc3accb8048 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:32:08.364 7fc3accb8048 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:32:08.364 7fc3accb8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:08.364 7fc3accb8048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:32:08.364 7fc3accb8048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:08.364 7fc3accb8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:32:08.365 7fc3accb8048 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:32:08.365 7fc3accb8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:08.365 7fc3accb8048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:32:08.365 7fc3accb8048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:08.365 7fc3accb8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:08.365 7fc3accb8048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:32:08.365 7fc3accb8048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:12.364 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:32:15.735 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51431524, partition_space_available_1k=29658960, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83288, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=75120, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42508, cpu_share=0.01, mem_res=39656, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15345284, free=9387164, buffers=997792, cached=6934880, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.8, five_min_avg=3.47, fifteen_min_avg=3.77, cpu_share=2.5, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:32:17.367 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:32:17.367 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:32:17.367 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:17.367 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:32:17.367 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:17.367 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:17.368 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51431524 partition_space_available_1k = 29658960 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 83288 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 75120 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42508 cpu_share = 0.01 mem_res = 39656 >> } system_mem_usage = << total = 32665120 used = 15345284 free = 9387164 buffers = 997792 cached = 6934880 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 2.8 five_min_avg = 3.47 fifteen_min_avg = 3.77 cpu_share = 2.5 node_type = analytics-snmp-node >> >> 06/02/2025 02:32:17.368 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:17.368 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:32:17.368 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:32:17.368 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:17.369 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:32:17.369 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:17.369 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:17.369 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:32:17.369 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:21.371 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:32:26.377 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:32:26.377 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:32:26.377 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:26.377 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:32:26.377 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:26.377 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:32:26.378 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:32:26.378 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:26.378 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:32:26.378 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:26.378 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:26.378 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:32:26.378 7fc3ac9ec780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:30.380 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:32:35.386 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:32:35.386 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:32:35.386 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:35.387 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:32:35.387 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:35.387 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:32:35.387 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:32:35.387 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:35.387 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:32:35.387 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:35.387 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:35.388 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:32:35.388 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:35.954 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:32:39.390 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:32:44.393 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:32:44.393 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:32:44.393 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:44.393 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:32:44.393 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:44.393 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:32:44.394 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:32:44.394 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:44.394 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:32:44.394 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:44.394 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:44.394 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:32:44.394 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:48.397 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:32:53.404 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:32:53.405 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:32:53.405 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:53.405 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:32:53.405 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:53.405 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:32:53.406 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:32:53.406 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:53.406 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:32:53.406 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:53.406 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:53.406 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:32:53.406 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:57.405 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:33:02.413 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:33:02.414 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:33:02.414 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:02.414 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:33:02.414 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:02.414 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:33:02.415 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:33:02.415 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:02.415 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:33:02.415 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:02.415 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:02.416 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:33:02.416 7fc3accd02e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:06.417 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:33:11.420 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:33:11.420 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:33:11.421 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:11.421 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:33:11.421 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:11.421 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:33:11.421 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:33:11.422 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:11.422 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:33:11.422 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:11.422 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:11.422 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:33:11.422 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:15.421 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:33:15.743 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51433304, partition_space_available_1k=29657180, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83320, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=75148, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42528, cpu_share=0.01, mem_res=39656, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15314864, free=9414992, buffers=997792, cached=6937472, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.35, five_min_avg=3.24, fifteen_min_avg=3.68, cpu_share=2.75, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:33:20.427 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:33:20.427 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:33:20.427 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:20.428 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:33:20.428 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:20.428 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:20.428 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51433304 partition_space_available_1k = 29657180 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 83320 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 75148 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42528 cpu_share = 0.01 mem_res = 39656 >> } system_mem_usage = << total = 32665120 used = 15314864 free = 9414992 buffers = 997792 cached = 6937472 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 2.35 five_min_avg = 3.24 fifteen_min_avg = 3.68 cpu_share = 2.75 node_type = analytics-snmp-node >> >> 06/02/2025 02:33:20.428 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:20.428 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:33:20.429 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:33:20.429 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:20.429 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:33:20.429 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:20.429 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:20.429 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:33:20.429 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:24.431 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:33:29.435 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:33:29.435 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:33:29.435 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:29.435 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:33:29.436 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:29.436 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:33:29.436 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:33:29.436 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:29.436 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:33:29.437 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:29.437 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:29.437 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:33:29.437 7fc3aa6112e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:33.439 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:33:38.446 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:33:38.446 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:33:38.446 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:38.446 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:33:38.446 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:38.446 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:33:38.447 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:33:38.447 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:38.447 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:33:38.447 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:38.447 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:38.447 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:33:38.448 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:42.450 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:33:47.455 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:33:47.455 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:33:47.455 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:47.455 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:33:47.455 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:47.455 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:33:47.456 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:33:47.456 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:47.456 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:33:47.456 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:47.456 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:47.456 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:33:47.457 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:51.458 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:33:56.465 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:33:56.465 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:33:56.465 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:56.465 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:33:56.465 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:56.465 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:33:56.466 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:33:56.466 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:56.466 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:33:56.466 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:56.466 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:56.466 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:33:56.466 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:00.465 7fc3aa63fcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:34:05.472 7fc3aa63fcc0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:34:05.472 7fc3aa63fcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:34:05.473 7fc3aa63fcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:05.473 7fc3aa63fcc0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:34:05.473 7fc3aa63fcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:05.473 7fc3aa63fcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:34:05.473 7fc3aa63fcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:34:05.473 7fc3aa63fcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:05.474 7fc3aa63fcc0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:34:05.474 7fc3aa63fcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:05.474 7fc3aa63fcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:05.474 7fc3aa63fcc0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:34:05.474 7fc3aa63fcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:09.476 7fc3aa63fcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:34:14.479 7fc3aa63fcc0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:34:14.480 7fc3aa63fcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:34:14.480 7fc3aa63fcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:14.480 7fc3aa63fcc0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:34:14.480 7fc3aa63fcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:14.480 7fc3aa63fcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:34:14.481 7fc3aa63fcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:34:14.481 7fc3aa63fcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:14.482 7fc3aa63fcc0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:34:14.482 7fc3aa63fcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:14.482 7fc3aa63fcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:14.482 7fc3aa63fcc0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:34:14.482 7fc3aa63fcc0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:15.744 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51434060, partition_space_available_1k=29656424, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83312, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=75140, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42520, cpu_share=0.01, mem_res=39656, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15314836, free=9413176, buffers=997912, cached=6939196, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.0, five_min_avg=2.99, fifteen_min_avg=3.56, cpu_share=2.75, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:34:15.744 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:15.744 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51434060 partition_space_available_1k = 29656424 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 83312 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 75140 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42520 cpu_share = 0.01 mem_res = 39656 >> } system_mem_usage = << total = 32665120 used = 15314836 free = 9413176 buffers = 997912 cached = 6939196 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 2.0 five_min_avg = 2.99 fifteen_min_avg = 3.56 cpu_share = 2.75 node_type = analytics-snmp-node >> >> 06/02/2025 02:34:15.744 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:18.480 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:34:23.487 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:34:23.487 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:34:23.488 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:23.488 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:34:23.488 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:23.488 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:34:23.488 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:34:23.488 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:23.489 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:34:23.489 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:23.489 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:23.489 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:34:23.489 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:27.491 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:34:32.497 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:34:32.497 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:34:32.497 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:32.497 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:34:32.497 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:32.497 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:34:32.498 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:34:32.498 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:32.498 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:34:32.498 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:32.498 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:32.498 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:34:32.498 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:36.501 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:34:41.507 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:34:41.507 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:34:41.507 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:41.508 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:34:41.508 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:41.508 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:34:41.508 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:34:41.508 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:41.508 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:34:41.508 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:41.508 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:41.508 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:34:41.509 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:45.509 7fc3acce2cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:34:50.515 7fc3acce2cc0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:34:50.515 7fc3acce2cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:34:50.516 7fc3acce2cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:50.516 7fc3acce2cc0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:34:50.516 7fc3acce2cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:50.516 7fc3acce2cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:34:50.517 7fc3acce2cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:34:50.517 7fc3acce2cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:50.517 7fc3acce2cc0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:34:50.517 7fc3acce2cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:50.517 7fc3acce2cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:50.517 7fc3acce2cc0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:34:50.517 7fc3acce2cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:54.519 7fc3acce2cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:34:59.522 7fc3acce2cc0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:34:59.522 7fc3acce2cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:34:59.522 7fc3acce2cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:59.522 7fc3acce2cc0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:34:59.523 7fc3acce2cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:59.523 7fc3acce2cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:34:59.524 7fc3acce2cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:34:59.524 7fc3acce2cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:59.524 7fc3acce2cc0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:34:59.524 7fc3acce2cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:59.524 7fc3acce2cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:59.524 7fc3acce2cc0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:34:59.524 7fc3acce2cc0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:03.525 7fc3b30e4a20 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:35:08.529 7fc3b30e4a20 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:35:08.529 7fc3b30e4a20 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:35:08.529 7fc3b30e4a20 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:08.529 7fc3b30e4a20 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:35:08.529 7fc3b30e4a20 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:08.529 7fc3b30e4a20 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:35:08.530 7fc3b30e4a20 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:35:08.530 7fc3b30e4a20 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:08.530 7fc3b30e4a20 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:35:08.530 7fc3b30e4a20 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:08.530 7fc3b30e4a20 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:08.530 7fc3b30e4a20 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:35:08.530 7fc3b30e4a20 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:12.529 7fc3accd0978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:35:15.744 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51439644, partition_space_available_1k=29650840, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83368, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=75192, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42576, cpu_share=0.01, mem_res=39656, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15311908, free=9414696, buffers=997912, cached=6940604, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.81, five_min_avg=2.75, fifteen_min_avg=3.44, cpu_share=2.75, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:35:17.534 7fc3accd0978 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:35:17.535 7fc3accd0978 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:35:17.535 7fc3accd0978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:17.535 7fc3accd0978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:35:17.535 7fc3accd0978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:17.535 7fc3accd0978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:17.536 7fc3accd0978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51439644 partition_space_available_1k = 29650840 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 83368 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 75192 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42576 cpu_share = 0.01 mem_res = 39656 >> } system_mem_usage = << total = 32665120 used = 15311908 free = 9414696 buffers = 997912 cached = 6940604 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 1.81 five_min_avg = 2.75 fifteen_min_avg = 3.44 cpu_share = 2.75 node_type = analytics-snmp-node >> >> 06/02/2025 02:35:17.536 7fc3accd0978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:17.536 7fc3accd0978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:35:17.536 7fc3accd0978 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:35:17.537 7fc3accd0978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:17.537 7fc3accd0978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:35:17.537 7fc3accd0978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:17.537 7fc3accd0978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:17.537 7fc3accd0978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:35:17.537 7fc3accd0978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:21.538 7fc3acea8630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:35:26.545 7fc3acea8630 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:35:26.545 7fc3acea8630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:35:26.545 7fc3acea8630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:26.545 7fc3acea8630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:35:26.545 7fc3acea8630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:26.545 7fc3acea8630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:35:26.546 7fc3acea8630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:35:26.546 7fc3acea8630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:26.546 7fc3acea8630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:35:26.546 7fc3acea8630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:26.546 7fc3acea8630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:26.546 7fc3acea8630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:35:26.546 7fc3acea8630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:30.546 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:35:35.550 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:35:35.550 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:35:35.550 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:35.550 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:35:35.550 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:35.550 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:35:35.551 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:35:35.551 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:35.551 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:35:35.551 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:35.551 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:35.551 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:35:35.551 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:39.554 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:35:44.556 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:35:44.557 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:35:44.557 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:44.557 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:35:44.557 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:44.557 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:35:44.558 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:35:44.558 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:44.558 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:35:44.558 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:44.558 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:44.558 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:35:44.558 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:48.560 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:35:53.566 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:35:53.566 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:35:53.566 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:53.567 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:35:53.568 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:53.568 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:35:53.569 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:35:53.569 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:53.569 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:35:53.569 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:53.569 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:53.569 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:35:53.569 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:57.571 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:36:02.573 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:36:02.573 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:36:02.573 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:02.573 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:36:02.573 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:02.573 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:36:02.574 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:36:02.575 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:02.575 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:36:02.575 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:02.575 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:02.575 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:36:02.575 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:06.577 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:36:11.581 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:36:11.581 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:36:11.581 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:11.582 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:36:11.582 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:11.582 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:36:11.582 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:36:11.583 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:11.583 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:36:11.583 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:11.583 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:11.583 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:36:11.583 7fc3ac7c34e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:14.288 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:36:15.582 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:36:15.763 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51446200, partition_space_available_1k=29644284, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83392, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=75220, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42604, cpu_share=0.01, mem_res=39656, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15348504, free=9370232, buffers=997980, cached=6948404, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.92, five_min_avg=2.62, fifteen_min_avg=3.35, cpu_share=3.0, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:36:20.589 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:36:20.589 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:36:20.589 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:20.589 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:36:20.589 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:20.589 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:20.590 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51446200 partition_space_available_1k = 29644284 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 83392 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 75220 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42604 cpu_share = 0.01 mem_res = 39656 >> } system_mem_usage = << total = 32665120 used = 15348504 free = 9370232 buffers = 997980 cached = 6948404 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 1.92 five_min_avg = 2.62 fifteen_min_avg = 3.35 cpu_share = 3.0 node_type = analytics-snmp-node >> >> 06/02/2025 02:36:20.590 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:20.590 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:36:20.590 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:36:20.590 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:20.590 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:36:20.590 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:20.590 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:20.590 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:36:20.590 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:24.597 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:36:24.737 7fc3accdb6d8 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:36:29.603 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:36:29.603 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:36:29.603 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:29.603 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:36:29.603 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:29.603 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:36:29.604 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:36:29.604 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:29.604 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:36:29.604 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:29.604 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:29.604 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:36:29.604 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:33.606 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:36:38.609 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:36:38.609 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:36:38.609 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:38.610 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:36:38.610 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:38.610 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:36:38.610 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:36:38.611 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:38.611 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:36:38.611 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:38.611 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:38.611 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:36:38.611 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:40.252 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:36:42.612 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:36:47.616 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:36:47.617 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:36:47.617 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:47.617 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:36:47.617 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:47.617 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:36:47.617 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:36:47.617 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:47.617 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:36:47.618 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:47.618 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:47.618 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:36:47.618 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:51.621 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:36:56.627 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:36:56.627 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:36:56.628 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:56.628 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:36:56.628 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:56.628 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:36:56.629 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:36:56.629 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:56.630 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:36:56.630 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:56.630 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:56.630 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:36:56.630 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:00.628 7fc3ad80fac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:37:05.633 7fc3ad80fac8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:37:05.633 7fc3ad80fac8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:37:05.633 7fc3ad80fac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:05.633 7fc3ad80fac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:37:05.633 7fc3ad80fac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:05.633 7fc3ad80fac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:37:05.634 7fc3ad80fac8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:37:05.634 7fc3ad80fac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:05.634 7fc3ad80fac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:37:05.634 7fc3ad80fac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:05.634 7fc3ad80fac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:05.634 7fc3ad80fac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:37:05.634 7fc3ad80fac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:09.637 7fc3ad80fac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:37:14.639 7fc3ad80fac8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:37:14.639 7fc3ad80fac8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:37:14.640 7fc3ad80fac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:14.640 7fc3ad80fac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:37:14.640 7fc3ad80fac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:14.640 7fc3ad80fac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:37:14.641 7fc3ad80fac8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:37:14.641 7fc3ad80fac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:14.641 7fc3ad80fac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:37:14.641 7fc3ad80fac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:14.641 7fc3ad80fac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:14.642 7fc3ad80fac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:37:14.642 7fc3ad80fac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:15.749 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51451228, partition_space_available_1k=29639256, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83392, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=75212, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42608, cpu_share=0.01, mem_res=39664, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15352708, free=9345512, buffers=997988, cached=6968912, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.88, five_min_avg=3.53, fifteen_min_avg=3.63, cpu_share=5.25, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:37:15.749 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:15.749 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51451228 partition_space_available_1k = 29639256 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 83392 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 75212 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42608 cpu_share = 0.01 mem_res = 39664 >> } system_mem_usage = << total = 32665120 used = 15352708 free = 9345512 buffers = 997988 cached = 6968912 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 4.88 five_min_avg = 3.53 fifteen_min_avg = 3.63 cpu_share = 5.25 node_type = analytics-snmp-node >> >> 06/02/2025 02:37:15.749 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:18.642 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:37:23.648 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:37:23.649 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:37:23.649 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:23.649 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:37:23.649 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:23.649 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:37:23.649 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:37:23.650 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:23.650 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:37:23.650 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:23.650 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:23.650 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:37:23.650 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:27.653 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:37:32.658 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:37:32.658 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:37:32.658 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:32.658 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:37:32.658 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:32.658 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:37:32.658 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:37:32.659 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:32.659 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:37:32.659 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:32.659 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:32.659 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:37:32.659 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:36.662 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:37:41.668 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:37:41.669 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:37:41.669 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:41.669 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:37:41.669 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:41.669 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:37:41.669 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:37:41.669 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:41.670 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:37:41.670 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:41.670 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:41.670 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:37:41.670 7fc3a9dff6d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:45.670 7fc3ac7e7ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:37:50.676 7fc3ac7e7ac8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:37:50.676 7fc3ac7e7ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:37:50.676 7fc3ac7e7ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:50.676 7fc3ac7e7ac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:37:50.676 7fc3ac7e7ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:50.676 7fc3ac7e7ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:37:50.677 7fc3ac7e7ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:37:50.677 7fc3ac7e7ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:50.677 7fc3ac7e7ac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:37:50.677 7fc3ac7e7ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:50.677 7fc3ac7e7ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:50.677 7fc3ac7e7ac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:37:50.677 7fc3ac7e7ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:54.679 7fc3ac7e7ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:37:59.685 7fc3ac7e7ac8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:37:59.685 7fc3ac7e7ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:37:59.685 7fc3ac7e7ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:59.685 7fc3ac7e7ac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:37:59.685 7fc3ac7e7ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:59.685 7fc3ac7e7ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:37:59.686 7fc3ac7e7ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:37:59.686 7fc3ac7e7ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:59.686 7fc3ac7e7ac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:37:59.686 7fc3ac7e7ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:59.686 7fc3ac7e7ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:59.686 7fc3ac7e7ac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:37:59.686 7fc3ac7e7ac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:03.689 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:38:08.693 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:38:08.693 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:38:08.693 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:08.693 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:38:08.693 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:08.693 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:38:08.694 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:38:08.694 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:08.694 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:38:08.694 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:08.694 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:08.694 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:38:08.694 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:12.694 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:38:15.750 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51453528, partition_space_available_1k=29636956, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83444, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=75268, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42660, cpu_share=0.01, mem_res=39664, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15377324, free=9319280, buffers=997988, cached=6970528, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.55, five_min_avg=3.4, fifteen_min_avg=3.58, cpu_share=2.5, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:38:17.698 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:38:17.698 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:38:17.699 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:17.699 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:38:17.699 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:17.699 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:17.699 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51453528 partition_space_available_1k = 29636956 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 83444 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 75268 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42660 cpu_share = 0.01 mem_res = 39664 >> } system_mem_usage = << total = 32665120 used = 15377324 free = 9319280 buffers = 997988 cached = 6970528 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 3.55 five_min_avg = 3.4 fifteen_min_avg = 3.58 cpu_share = 2.5 node_type = analytics-snmp-node >> >> 06/02/2025 02:38:17.699 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:17.699 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:38:17.700 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:38:17.700 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:17.700 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:38:17.700 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:17.700 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:17.700 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:38:17.700 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:21.701 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:38:24.350 7fc3aa611eb8 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:38:26.705 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:38:26.706 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:38:26.706 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:26.706 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:38:26.706 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:26.706 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:38:26.707 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:38:26.707 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:26.707 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:38:26.707 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:26.707 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:26.707 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:38:26.707 7fc3ac8c8588 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:30.705 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:38:35.712 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:38:35.712 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:38:35.712 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:35.713 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:38:35.713 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:35.713 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:38:35.713 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:38:35.714 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:35.714 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:38:35.714 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:35.714 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:35.714 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:38:35.714 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:39.716 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:38:44.721 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:38:44.721 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:38:44.721 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:44.722 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:38:44.722 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:44.722 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:38:44.722 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:38:44.723 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:44.723 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:38:44.723 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:44.723 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:44.723 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:38:44.723 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:48.724 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:38:53.730 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:38:53.730 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:38:53.730 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:53.731 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:38:53.731 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:53.731 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:38:53.731 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:38:53.731 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:53.731 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:38:53.731 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:53.731 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:53.732 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:38:53.732 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:57.735 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:39:02.737 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:39:02.737 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:39:02.737 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:02.737 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:39:02.737 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:02.737 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:39:02.738 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:39:02.738 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:02.738 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:39:02.738 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:02.738 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:02.738 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:39:02.738 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:06.741 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:39:11.745 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:39:11.745 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:39:11.746 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:11.746 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:39:11.746 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:11.746 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:39:11.748 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:39:11.748 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:11.748 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:39:11.748 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:11.749 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:11.749 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:39:11.750 7fc3ac9ec0f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:15.747 7fc3accdbd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:39:15.752 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51454648, partition_space_available_1k=29635836, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83472, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=75292, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42776, cpu_share=0.01, mem_res=39664, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15339608, free=9352056, buffers=997996, cached=6975460, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.82, five_min_avg=3.23, fifteen_min_avg=3.51, cpu_share=2.62, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:39:20.754 7fc3accdbd68 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:39:20.755 7fc3accdbd68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:39:20.755 7fc3accdbd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:20.755 7fc3accdbd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:39:20.755 7fc3accdbd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:20.755 7fc3accdbd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:20.756 7fc3accdbd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51454648 partition_space_available_1k = 29635836 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 83472 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 75292 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42776 cpu_share = 0.01 mem_res = 39664 >> } system_mem_usage = << total = 32665120 used = 15339608 free = 9352056 buffers = 997996 cached = 6975460 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 2.82 five_min_avg = 3.23 fifteen_min_avg = 3.51 cpu_share = 2.62 node_type = analytics-snmp-node >> >> 06/02/2025 02:39:20.756 7fc3accdbd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:20.756 7fc3accdbd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:39:20.757 7fc3accdbd68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:39:20.757 7fc3accdbd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:20.757 7fc3accdbd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:39:20.757 7fc3accdbd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:20.757 7fc3accdbd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:20.757 7fc3accdbd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:39:20.758 7fc3accdbd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:24.758 7fc3b30cfe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:39:29.764 7fc3b30cfe10 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:39:29.764 7fc3b30cfe10 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:39:29.765 7fc3b30cfe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:29.765 7fc3b30cfe10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:39:29.765 7fc3b30cfe10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:29.765 7fc3b30cfe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:39:29.765 7fc3b30cfe10 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:39:29.766 7fc3b30cfe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:29.766 7fc3b30cfe10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:39:29.766 7fc3b30cfe10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:29.766 7fc3b30cfe10 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:29.766 7fc3b30cfe10 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:39:29.766 7fc3b30cfe10 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:33.765 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:39:38.769 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:39:38.769 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:39:38.769 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:38.769 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:39:38.769 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:38.770 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:39:38.770 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:39:38.770 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:38.771 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:39:38.771 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:38.771 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:38.771 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:39:38.771 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:42.772 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:39:47.775 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:39:47.775 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:39:47.775 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:47.775 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:39:47.776 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:47.776 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:39:47.776 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:39:47.776 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:47.776 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:39:47.777 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:47.777 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:47.777 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:39:47.777 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:51.779 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:39:56.785 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:39:56.785 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:39:56.785 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:56.785 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:39:56.785 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:56.785 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:39:56.785 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:39:56.786 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:56.786 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:39:56.786 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:56.786 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:56.786 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:39:56.786 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:00.789 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:40:05.794 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:40:05.795 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:40:05.795 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:05.795 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:40:05.795 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:05.795 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:40:05.796 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:40:05.796 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:05.796 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:40:05.796 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:05.796 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:05.796 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:40:05.796 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:09.798 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:40:14.801 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:40:14.802 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:40:14.802 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:14.802 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:40:14.802 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:14.803 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:40:14.803 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:40:14.804 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:14.804 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:40:14.804 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:14.804 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:14.804 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:40:14.804 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:15.758 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51461420, partition_space_available_1k=29629064, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83468, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=75288, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42672, cpu_share=0.01, mem_res=39664, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15458840, free=9220956, buffers=998000, cached=6987324, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.31, five_min_avg=2.99, fifteen_min_avg=3.41, cpu_share=2.75, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:40:15.759 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:15.759 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51461420 partition_space_available_1k = 29629064 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 83468 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 75288 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42672 cpu_share = 0.01 mem_res = 39664 >> } system_mem_usage = << total = 32665120 used = 15458840 free = 9220956 buffers = 998000 cached = 6987324 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 2.31 five_min_avg = 2.99 fifteen_min_avg = 3.41 cpu_share = 2.75 node_type = analytics-snmp-node >> >> 06/02/2025 02:40:15.759 7fc3a86896d8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:17.622 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:40:18.802 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:40:23.810 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:40:23.810 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:40:23.811 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:23.811 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:40:23.811 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:23.811 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:40:23.811 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:40:23.811 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:23.812 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:40:23.812 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:23.812 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:23.812 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:40:23.812 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:27.814 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:40:28.050 7fc3a87d0780 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:40:32.817 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:40:32.818 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:40:32.818 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:32.818 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:40:32.818 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:32.818 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:40:32.818 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:40:32.818 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:32.819 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:40:32.819 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:32.819 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:32.819 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:40:32.819 7fc3a9dcf630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:36.823 7fc3aa628a20 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:40:40.275 7fc3aa634978 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:40:41.845 7fc3aa628a20 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:40:41.845 7fc3aa628a20 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:40:41.845 7fc3aa628a20 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:41.845 7fc3aa628a20 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:40:41.845 7fc3aa628a20 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:41.845 7fc3aa628a20 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:40:41.846 7fc3aa628a20 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:40:41.846 7fc3aa628a20 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:41.846 7fc3aa628a20 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:40:41.846 7fc3aa628a20 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:41.846 7fc3aa628a20 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:41.846 7fc3aa628a20 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:40:41.846 7fc3aa628a20 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:45.849 7fc3aa628a20 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:40:50.853 7fc3aa628a20 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:40:50.853 7fc3aa628a20 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:40:50.853 7fc3aa628a20 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:50.853 7fc3aa628a20 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:40:50.853 7fc3aa628a20 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:50.853 7fc3aa628a20 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:40:50.854 7fc3aa628a20 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:40:50.854 7fc3aa628a20 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:50.854 7fc3aa628a20 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:40:50.854 7fc3aa628a20 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:50.854 7fc3aa628a20 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:50.855 7fc3aa628a20 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:40:50.855 7fc3aa628a20 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:54.857 7fc3accdb780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:40:59.863 7fc3accdb780 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:40:59.864 7fc3accdb780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:40:59.864 7fc3accdb780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:59.864 7fc3accdb780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:40:59.864 7fc3accdb780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:59.864 7fc3accdb780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:40:59.865 7fc3accdb780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:40:59.865 7fc3accdb780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:59.865 7fc3accdb780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:40:59.865 7fc3accdb780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:59.865 7fc3accdb780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:59.865 7fc3accdb780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:40:59.865 7fc3accdb780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:03.865 7fc3a9db5630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:41:08.871 7fc3a9db5630 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:41:08.871 7fc3a9db5630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:41:08.872 7fc3a9db5630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:08.872 7fc3a9db5630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:41:08.872 7fc3a9db5630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:08.872 7fc3a9db5630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:41:08.872 7fc3a9db5630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:41:08.872 7fc3a9db5630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:08.872 7fc3a9db5630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:41:08.872 7fc3a9db5630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:08.873 7fc3a9db5630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:08.873 7fc3a9db5630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:41:08.873 7fc3a9db5630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:12.873 7fc3acce54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:41:15.770 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51470744, partition_space_available_1k=29619740, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83520, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=75336, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42736, cpu_share=0.01, mem_res=39664, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15417328, free=9245680, buffers=998008, cached=7004104, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.5, five_min_avg=4.33, fifteen_min_avg=3.86, cpu_share=5.12, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:41:17.876 7fc3acce54e0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:41:17.876 7fc3acce54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:41:17.876 7fc3acce54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:17.876 7fc3acce54e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:41:17.876 7fc3acce54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:17.876 7fc3acce54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:17.876 7fc3acce54e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51470744 partition_space_available_1k = 29619740 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 83520 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 75336 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42736 cpu_share = 0.01 mem_res = 39664 >> } system_mem_usage = << total = 32665120 used = 15417328 free = 9245680 buffers = 998008 cached = 7004104 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 6.5 five_min_avg = 4.33 fifteen_min_avg = 3.86 cpu_share = 5.12 node_type = analytics-snmp-node >> >> 06/02/2025 02:41:17.877 7fc3acce54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:17.877 7fc3acce54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:41:17.877 7fc3acce54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:41:17.877 7fc3acce54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:17.878 7fc3acce54e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:41:17.878 7fc3acce54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:17.878 7fc3acce54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:17.878 7fc3acce54e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:41:17.878 7fc3acce54e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:21.879 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:41:26.885 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:41:26.885 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:41:26.885 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:26.885 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:41:26.885 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:26.885 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:41:26.886 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:41:26.886 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:26.886 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:41:26.886 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:26.886 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:26.886 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:41:26.886 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:30.889 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:41:35.895 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:41:35.895 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:41:35.895 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:35.895 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:41:35.895 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:35.895 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:41:35.896 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:41:35.896 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:35.896 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:41:35.896 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:35.896 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:35.896 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:41:35.896 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:39.898 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:41:44.905 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:41:44.905 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:41:44.905 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:44.906 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:41:44.906 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:44.906 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:41:44.906 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:41:44.907 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:44.907 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:41:44.907 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:44.907 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:44.907 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:41:44.907 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:48.906 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:41:53.913 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:41:53.913 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:41:53.913 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:53.913 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:41:53.913 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:53.913 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:41:53.914 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:41:53.914 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:53.914 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:41:53.915 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:53.915 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:53.915 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:41:53.916 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:57.917 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:42:02.919 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:42:02.919 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:42:02.919 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:02.919 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:42:02.919 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:02.919 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:42:02.920 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:42:02.920 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:02.921 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:42:02.921 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:02.921 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:02.921 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:42:02.921 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:06.921 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:42:11.923 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:42:11.924 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:42:11.924 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:11.924 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:42:11.924 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:11.924 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:42:11.925 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:42:11.925 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:11.925 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:42:11.925 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:11.925 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:11.926 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:42:11.926 7fc3a9dff630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:15.758 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51472916, partition_space_available_1k=29617568, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83548, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=75364, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42724, cpu_share=0.01, mem_res=39664, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15423212, free=9238000, buffers=998008, cached=7005900, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.06, five_min_avg=3.98, fifteen_min_avg=3.77, cpu_share=2.5, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:42:15.759 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:15.759 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51472916 partition_space_available_1k = 29617568 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 83548 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 75364 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42724 cpu_share = 0.01 mem_res = 39664 >> } system_mem_usage = << total = 32665120 used = 15423212 free = 9238000 buffers = 998008 cached = 7005900 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 4.06 five_min_avg = 3.98 fifteen_min_avg = 3.77 cpu_share = 2.5 node_type = analytics-snmp-node >> >> 06/02/2025 02:42:15.759 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:15.924 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:42:20.929 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:42:20.929 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:42:20.929 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:20.930 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:42:20.930 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:20.930 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:42:20.930 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:42:20.930 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:20.931 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:42:20.931 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:20.931 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:20.931 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:42:20.931 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:24.932 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:42:29.937 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:42:29.938 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:42:29.938 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:29.938 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:42:29.938 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:29.938 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:42:29.939 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:42:29.939 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:29.939 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:42:29.939 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:29.939 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:29.939 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:42:29.939 7fc3b3986eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:33.939 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:42:38.945 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:42:38.945 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:42:38.946 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:38.946 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:42:38.946 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:38.946 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:42:38.946 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:42:38.947 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:38.947 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:42:38.947 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:38.947 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:38.947 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:42:38.947 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:42.948 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:42:47.952 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:42:47.952 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:42:47.952 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:47.952 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:42:47.952 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:47.952 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:42:47.953 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:42:47.953 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:47.953 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:42:47.953 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:47.953 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:47.953 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:42:47.953 7fc3ac9ec828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:51.956 7fc3aa611d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:42:56.961 7fc3aa611d68 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:42:56.962 7fc3aa611d68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:42:56.962 7fc3aa611d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:56.962 7fc3aa611d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:42:56.962 7fc3aa611d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:56.962 7fc3aa611d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:42:56.962 7fc3aa611d68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:42:56.963 7fc3aa611d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:56.963 7fc3aa611d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:42:56.963 7fc3aa611d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:56.963 7fc3aa611d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:56.963 7fc3aa611d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:42:56.963 7fc3aa611d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:00.966 7fc3aa611d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:43:05.970 7fc3aa611d68 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:43:05.970 7fc3aa611d68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:43:05.970 7fc3aa611d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:05.970 7fc3aa611d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:43:05.971 7fc3aa611d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:05.971 7fc3aa611d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:43:05.971 7fc3aa611d68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:43:05.971 7fc3aa611d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:05.971 7fc3aa611d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:43:05.971 7fc3aa611d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:05.972 7fc3aa611d68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:05.972 7fc3aa611d68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:43:05.972 7fc3aa611d68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:09.973 7fc3a9dccac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:43:14.975 7fc3a9dccac8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:43:14.976 7fc3a9dccac8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:43:14.976 7fc3a9dccac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:14.976 7fc3a9dccac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:43:14.977 7fc3a9dccac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:14.977 7fc3a9dccac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:43:14.978 7fc3a9dccac8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:43:14.978 7fc3a9dccac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:14.978 7fc3a9dccac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:43:14.978 7fc3a9dccac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:14.978 7fc3a9dccac8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:14.978 7fc3a9dccac8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:43:14.979 7fc3a9dccac8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:15.765 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51478280, partition_space_available_1k=29612204, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83544, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=75360, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42748, cpu_share=0.01, mem_res=39664, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15498424, free=9155836, buffers=998008, cached=7012852, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.43, five_min_avg=3.82, fifteen_min_avg=3.72, cpu_share=2.75, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:43:15.765 7fc3a924f4e0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:15.765 7fc3a924f4e0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51478280 partition_space_available_1k = 29612204 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 83544 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 75360 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42748 cpu_share = 0.01 mem_res = 39664 >> } system_mem_usage = << total = 32665120 used = 15498424 free = 9155836 buffers = 998008 cached = 7012852 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 3.43 five_min_avg = 3.82 fifteen_min_avg = 3.72 cpu_share = 2.75 node_type = analytics-snmp-node >> >> 06/02/2025 02:43:15.765 7fc3a924f4e0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:16.339 7fc3a924f4e0 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:43:18.977 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:43:23.983 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:43:23.983 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:43:23.984 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:23.984 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:43:23.984 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:23.984 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:43:23.984 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:43:23.985 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:23.985 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:43:23.985 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:23.985 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:23.985 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:43:23.985 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:27.987 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:43:32.993 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:43:32.993 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:43:32.993 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:32.993 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:43:32.993 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:32.994 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:43:32.994 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:43:32.994 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:32.994 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:43:32.994 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:32.994 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:32.995 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:43:32.995 7fc3acce20f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:36.996 7fc3aa634b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:43:42.002 7fc3aa634b70 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:43:42.003 7fc3aa634b70 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:43:42.003 7fc3aa634b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:42.003 7fc3aa634b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:43:42.003 7fc3aa634b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:42.003 7fc3aa634b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:43:42.003 7fc3aa634b70 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:43:42.004 7fc3aa634b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:42.004 7fc3aa634b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:43:42.004 7fc3aa634b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:42.004 7fc3aa634b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:42.004 7fc3aa634b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:43:42.004 7fc3aa634b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:46.007 7fc3aa634b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:43:51.011 7fc3aa634b70 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:43:51.011 7fc3aa634b70 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:43:51.011 7fc3aa634b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:51.012 7fc3aa634b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:43:51.012 7fc3aa634b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:51.012 7fc3aa634b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:43:51.012 7fc3aa634b70 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:43:51.012 7fc3aa634b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:51.012 7fc3aa634b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:43:51.012 7fc3aa634b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:51.012 7fc3aa634b70 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:51.013 7fc3aa634b70 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:43:51.013 7fc3aa634b70 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:55.015 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:44:00.023 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:44:00.023 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:44:00.023 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:00.023 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:44:00.023 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:00.023 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:44:00.024 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:44:00.024 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:00.024 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:44:00.024 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:00.024 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:00.024 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:44:00.024 7fc3a9e13978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:04.023 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:44:09.029 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:44:09.029 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:44:09.029 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:09.029 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:44:09.029 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:09.030 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:44:09.030 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:44:09.030 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:09.030 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:44:09.030 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:09.030 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:09.031 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:44:09.031 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:13.030 7fc3a87cdeb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:44:15.760 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51475304, partition_space_available_1k=29615180, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83604, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=75412, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42804, cpu_share=0.01, mem_res=39664, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15403684, free=9252860, buffers=998008, cached=7010568, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.63, five_min_avg=3.53, fifteen_min_avg=3.63, cpu_share=2.62, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:44:18.033 7fc3a87cdeb8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:44:18.033 7fc3a87cdeb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:44:18.034 7fc3a87cdeb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:18.034 7fc3a87cdeb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:44:18.034 7fc3a87cdeb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:18.034 7fc3a87cdeb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:18.034 7fc3a87cdeb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51475304 partition_space_available_1k = 29615180 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 83604 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 75412 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42804 cpu_share = 0.01 mem_res = 39664 >> } system_mem_usage = << total = 32665120 used = 15403684 free = 9252860 buffers = 998008 cached = 7010568 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 2.63 five_min_avg = 3.53 fifteen_min_avg = 3.63 cpu_share = 2.62 node_type = analytics-snmp-node >> >> 06/02/2025 02:44:18.034 7fc3a87cdeb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:18.034 7fc3a87cdeb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:44:18.035 7fc3a87cdeb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:44:18.035 7fc3a87cdeb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:18.035 7fc3a87cdeb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:44:18.035 7fc3a87cdeb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:18.035 7fc3a87cdeb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:18.035 7fc3a87cdeb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:44:18.035 7fc3a87cdeb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:22.037 7fc3a9db8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:44:27.043 7fc3a9db8048 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:44:27.043 7fc3a9db8048 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:44:27.043 7fc3a9db8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:27.043 7fc3a9db8048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:44:27.043 7fc3a9db8048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:27.043 7fc3a9db8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:44:27.044 7fc3a9db8048 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:44:27.044 7fc3a9db8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:27.044 7fc3a9db8048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:44:27.044 7fc3a9db8048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:27.044 7fc3a9db8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:27.044 7fc3a9db8048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:44:27.044 7fc3a9db8048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:31.047 7fc3a9db8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:44:36.051 7fc3a9db8048 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:44:36.051 7fc3a9db8048 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:44:36.051 7fc3a9db8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:36.051 7fc3a9db8048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:44:36.051 7fc3a9db8048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:36.051 7fc3a9db8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:44:36.052 7fc3a9db8048 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:44:36.052 7fc3a9db8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:36.052 7fc3a9db8048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:44:36.052 7fc3a9db8048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:36.052 7fc3a9db8048 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:36.052 7fc3a9db8048 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:44:36.052 7fc3a9db8048 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:40.054 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:44:45.061 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:44:45.061 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:44:45.061 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:45.061 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:44:45.061 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:45.061 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:44:45.061 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:44:45.062 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:45.062 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:44:45.062 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:45.062 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:45.062 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:44:45.062 7fc3aaa8cd68 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:49.063 7fc3accd0828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:44:54.070 7fc3accd0828 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:44:54.071 7fc3accd0828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:44:54.071 7fc3accd0828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:54.071 7fc3accd0828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:44:54.071 7fc3accd0828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:54.071 7fc3accd0828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:44:54.071 7fc3accd0828 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:44:54.072 7fc3accd0828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:54.072 7fc3accd0828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:44:54.072 7fc3accd0828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:54.072 7fc3accd0828 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:54.072 7fc3accd0828 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:44:54.072 7fc3accd0828 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:58.075 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:45:03.081 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:45:03.081 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:45:03.081 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:03.082 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:45:03.082 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:03.082 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:45:03.083 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:45:03.083 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:03.083 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:45:03.083 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:03.083 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:03.083 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:45:03.083 7fc3aca3c2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:07.085 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:45:12.087 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:45:12.087 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:45:12.088 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:12.088 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:45:12.088 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:12.088 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:45:12.088 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:45:12.089 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:12.089 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:45:12.089 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:12.089 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:12.089 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:45:12.089 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:15.765 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51480872, partition_space_available_1k=29609612, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83624, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=75436, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42792, cpu_share=0.01, mem_res=39664, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15401512, free=9248804, buffers=998008, cached=7016796, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.98, five_min_avg=3.44, fifteen_min_avg=3.59, cpu_share=2.75, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:45:15.765 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:15.765 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51480872 partition_space_available_1k = 29609612 percentage_partition_space_used = 63 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 83624 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 75436 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42792 cpu_share = 0.01 mem_res = 39664 >> } system_mem_usage = << total = 32665120 used = 15401512 free = 9248804 buffers = 998008 cached = 7016796 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 2.98 five_min_avg = 3.44 fifteen_min_avg = 3.59 cpu_share = 2.75 node_type = analytics-snmp-node >> >> 06/02/2025 02:45:15.765 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:16.088 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:45:21.092 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:45:21.092 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:45:21.092 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:21.092 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:45:21.092 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:21.092 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:45:21.094 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:45:21.094 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:21.094 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:45:21.094 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:21.094 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:21.095 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:45:21.095 7fc3aa63f198 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:25.096 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:45:30.102 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:45:30.102 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:45:30.102 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:30.102 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:45:30.102 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:30.104 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:45:30.104 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:45:30.106 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:30.106 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:45:30.106 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:30.106 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:30.106 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:45:30.106 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:34.105 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:45:39.109 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:45:39.110 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:45:39.110 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:39.110 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:45:39.110 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:39.110 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:45:39.112 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:45:39.112 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:39.112 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:45:39.112 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:39.112 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:39.113 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:45:39.113 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:43.112 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:45:48.117 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:45:48.117 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:45:48.117 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:48.117 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:45:48.118 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:48.118 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:45:48.118 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:45:48.118 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:48.118 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:45:48.119 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:48.119 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:48.119 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:45:48.119 7fc3a9dff780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:52.118 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:45:55.446 7fc3a9dd1c18 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:45:57.122 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:45:57.122 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:45:57.123 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:57.123 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:45:57.123 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:57.123 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:45:57.123 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:45:57.123 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:57.123 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:45:57.123 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:57.124 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:57.124 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:45:57.124 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:01.126 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:46:05.525 7fc3a9e13a20 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:46:06.129 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:46:06.129 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:46:06.130 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:06.130 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:46:06.130 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:06.130 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:46:06.131 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:46:06.131 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:06.131 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:46:06.131 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:06.131 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:06.131 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:46:06.131 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:10.132 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:46:15.135 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:46:15.135 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:46:15.135 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:15.136 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:46:15.136 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:15.136 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:46:15.137 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:46:15.137 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:15.137 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:46:15.137 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:15.137 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:15.137 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:46:15.138 7fc3acce5eb8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:15.786 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51494464, partition_space_available_1k=29596020, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83620, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=75428, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42820, cpu_share=0.01, mem_res=39664, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15519820, free=9104332, buffers=998008, cached=7042960, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.54, five_min_avg=4.41, fifteen_min_avg=3.93, cpu_share=5.5, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:46:15.786 7fc3a9e16978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:15.787 7fc3a9e16978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51494464 partition_space_available_1k = 29596020 percentage_partition_space_used = 64 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 83620 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 75428 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42820 cpu_share = 0.01 mem_res = 39664 >> } system_mem_usage = << total = 32665120 used = 15519820 free = 9104332 buffers = 998008 cached = 7042960 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 5.54 five_min_avg = 4.41 fifteen_min_avg = 3.93 cpu_share = 5.5 node_type = analytics-snmp-node >> >> 06/02/2025 02:46:15.787 7fc3a9e16978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:16.461 7fc3a9e16978 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:46:19.137 7fc3a9e16978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:46:24.143 7fc3a9e16978 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:46:24.143 7fc3a9e16978 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:46:24.143 7fc3a9e16978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:24.144 7fc3a9e16978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:46:24.144 7fc3a9e16978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:24.144 7fc3a9e16978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:46:24.144 7fc3a9e16978 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:46:24.144 7fc3a9e16978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:24.145 7fc3a9e16978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:46:24.145 7fc3a9e16978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:24.145 7fc3a9e16978 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:24.145 7fc3a9e16978 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:46:24.145 7fc3a9e16978 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:28.147 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:46:33.153 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:46:33.153 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:46:33.153 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:33.154 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:46:33.154 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:33.154 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:46:33.154 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:46:33.154 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:33.154 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:46:33.154 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:33.155 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:33.155 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:46:33.155 7fc3acc50780 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:37.155 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:46:42.162 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:46:42.162 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:46:42.162 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:42.162 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:46:42.162 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:42.163 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:46:42.163 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:46:42.163 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:42.163 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:46:42.163 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:42.163 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:42.164 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:46:42.164 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:46.165 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:46:51.168 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:46:51.169 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:46:51.169 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:51.169 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:46:51.169 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:51.169 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:46:51.169 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:46:51.170 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:51.170 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:46:51.170 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:51.170 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:51.170 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:46:51.170 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:55.172 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:47:00.178 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:47:00.179 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:47:00.179 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:00.179 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:47:00.179 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:00.179 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:47:00.180 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:47:00.180 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:00.180 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:47:00.180 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:00.180 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:00.180 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:47:00.180 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:04.181 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:47:09.185 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:47:09.186 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:47:09.186 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:09.186 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:47:09.186 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:09.186 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:47:09.187 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:47:09.187 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:09.187 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:47:09.187 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:09.187 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:09.187 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:47:09.187 7fc3a9dcc2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:13.187 7fc3acc660f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:47:15.769 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51493388, partition_space_available_1k=29597096, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83676, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=75480, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42876, cpu_share=0.01, mem_res=39668, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15437204, free=9189352, buffers=998012, cached=7040552, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.82, five_min_avg=4.09, fifteen_min_avg=3.85, cpu_share=2.75, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:47:18.190 7fc3acc660f0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:47:18.190 7fc3acc660f0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:47:18.190 7fc3acc660f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:18.190 7fc3acc660f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:47:18.191 7fc3acc660f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:18.191 7fc3acc660f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:18.191 7fc3acc660f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51493388 partition_space_available_1k = 29597096 percentage_partition_space_used = 64 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 83676 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 75480 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42876 cpu_share = 0.01 mem_res = 39668 >> } system_mem_usage = << total = 32665120 used = 15437204 free = 9189352 buffers = 998012 cached = 7040552 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 3.82 five_min_avg = 4.09 fifteen_min_avg = 3.85 cpu_share = 2.75 node_type = analytics-snmp-node >> >> 06/02/2025 02:47:18.191 7fc3acc660f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:18.191 7fc3acc660f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:47:18.192 7fc3acc660f0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:47:18.192 7fc3acc660f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:18.192 7fc3acc660f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:47:18.192 7fc3acc660f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:18.192 7fc3acc660f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:18.192 7fc3acc660f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:47:18.192 7fc3acc660f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:22.191 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:47:26.926 7fc3a87d0780 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:47:27.195 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:47:27.195 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:47:27.195 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:27.196 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:47:27.196 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:27.196 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:47:27.196 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:47:27.196 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:27.196 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:47:27.196 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:27.197 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:27.197 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:47:27.197 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:31.197 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:47:36.199 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:47:36.199 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:47:36.200 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:36.200 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:47:36.200 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:36.200 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:47:36.201 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:47:36.201 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:36.201 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:47:36.201 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:36.201 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:36.201 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:47:36.201 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:40.202 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:47:45.208 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:47:45.208 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:47:45.208 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:45.209 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:47:45.209 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:45.209 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:47:45.209 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:47:45.209 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:45.209 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:47:45.209 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:45.209 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:45.209 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:47:45.210 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:49.210 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:47:54.215 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:47:54.215 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:47:54.215 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:54.215 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:47:54.216 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:54.216 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:47:54.216 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:47:54.216 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:54.216 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:47:54.216 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:54.216 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:54.217 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:47:54.217 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:58.219 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:48:03.225 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:48:03.226 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:48:03.226 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:48:03.226 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:48:03.226 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:48:03.226 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:48:03.227 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:48:03.227 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:03.227 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:48:03.227 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:03.227 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:03.227 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:48:03.227 7fc3b2043f60 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:07.226 7fc3a9dcf2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:48:12.229 7fc3a9dcf2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:48:12.229 7fc3a9dcf2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:48:12.229 7fc3a9dcf2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:48:12.229 7fc3a9dcf2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:48:12.229 7fc3a9dcf2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:48:12.229 7fc3a9dcf2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:48:12.230 7fc3a9dcf2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:48:12.230 7fc3a9dcf2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:12.230 7fc3a9dcf2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:48:12.230 7fc3a9dcf2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:12.230 7fc3a9dcf2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:12.231 7fc3a9dcf2e8 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:48:12.231 7fc3a9dcf2e8 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:15.770 7fc3ace7e888 [contrail-analytics-snmp-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-542-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51494976, partition_space_available_1k=29595508, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-snmp-collector': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83668, cpu_share=0.0, mem_res=75780, _EventManager__key='contrail-snmp-collector'), 'contrail-topology': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=75480, cpu_share=0.0, mem_res=69636, _EventManager__key='contrail-topology'), 'contrail-analytics-snmp-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42872, cpu_share=0.01, mem_res=39668, _EventManager__key='contrail-analytics-snmp-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=15444708, free=9119056, buffers=999332, cached=7102024, node_type='analytics-snmp-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.42, five_min_avg=3.95, fifteen_min_avg=3.82, cpu_share=3.0, node_type='analytics-snmp-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsSNMPInfo') 06/02/2025 02:48:15.770 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:15.770 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 51494976 partition_space_available_1k = 29595508 percentage_partition_space_used = 64 >> } process_mem_cpu_usage = { contrail-snmp-collector : << mem_virt = 83668 cpu_share = 0.0 mem_res = 75780 >>contrail-topology : << mem_virt = 75480 cpu_share = 0.0 mem_res = 69636 >>contrail-analytics-snmp-nodemgr : << mem_virt = 42872 cpu_share = 0.01 mem_res = 39668 >> } system_mem_usage = << total = 32665120 used = 15444708 free = 9119056 buffers = 999332 cached = 7102024 node_type = analytics-snmp-node >> system_cpu_usage = << one_min_avg = 3.42 five_min_avg = 3.95 fifteen_min_avg = 3.82 cpu_share = 3.0 node_type = analytics-snmp-node >> >> 06/02/2025 02:48:15.771 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:16.229 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:48:21.232 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:48:21.232 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:48:21.232 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:48:21.232 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:48:21.233 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:48:21.233 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:48:21.233 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:48:21.233 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:21.233 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:48:21.233 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:21.233 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:21.233 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:48:21.234 7fc3ad819630 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:25.237 7fc3ace560f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:48:28.754 7fc3a9dcf048 [contrail-analytics-snmp-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 06/02/2025 02:48:30.240 7fc3ace560f0 [contrail-analytics-snmp-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:48:30.240 7fc3ace560f0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:48:30.241 7fc3ace560f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:48:30.241 7fc3ace560f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:48:30.241 7fc3ace560f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:48:30.241 7fc3ace560f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:48:30.241 7fc3ace560f0 [contrail-analytics-snmp-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:48:30.241 7fc3ace560f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:30.241 7fc3ace560f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-snmp-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:48:30.242 7fc3ace560f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:30.242 7fc3ace560f0 [contrail-analytics-snmp-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:30.242 7fc3ace560f0 [contrail-analytics-snmp-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:AnalyticsSNMP:contrail-analytics-snmp-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8114 start_time = 1748829969975882 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 06/02/2025 02:48:30.242 7fc3ace560f0 [contrail-analytics-snmp-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]