08/07/2025 02:06:38.576 7f7d1afbebc8 [contrail-config-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 08/07/2025 02:06:38.576 7f7d1afbebc8 [contrail-config-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 08/07/2025 02:06:38.576 7f7d1afbebc8 [contrail-config-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 08/07/2025 02:06:38.585 7f7d184ef2e8 [contrail-config-nodemgr] [ERROR]: Cannot write http_port 8100 to /tmp/contrail-config-nodemgr.0.http_port 08/07/2025 02:06:38.586 7f7d184ef2e8 [contrail-config-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8100 08/07/2025 02:06:38.586 7f7d184f1c18 [contrail-config-nodemgr] [INFO]: Processing event[EvStart] in state[none] 08/07/2025 02:06:38.587 7f7d184f1c18 [contrail-config-nodemgr] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 08/07/2025 02:06:38.587 7f7d184f1c18 [contrail-config-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 08/07/2025 02:06:38.587 7f7d184f1c18 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 08/07/2025 02:06:38.588 7f7d184f1c18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:38.588 7f7d184f1c18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 08/07/2025 02:06:38.588 7f7d184f1c18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:38.588 7f7d184f1c18 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:38.588 7f7d184f1c18 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 08/07/2025 02:06:38.588 7f7d184f1c18 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:38.745 7f7d1afbebc8 [contrail-config-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-api', 'group': 'contrail-api', 'pid': 111498488745555147914432260432997551925799698141632730380959971543762645305145, 'start': '1754532396000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-schema', 'group': 'contrail-schema', 'pid': 30547141333761329747022889987067094182294031213805002159265052413167018401492, 'start': '1754532396000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-svc-monitor', 'group': 'contrail-svc-monitor', 'pid': 53475144748207987998930124266402564674761419063101510509722629586391899084312, 'start': '1754532396000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-device-manager', 'group': 'contrail-device-manager', 'pid': 77934287347700828931863059372565282882783761311287624314110728041039273208598, 'start': '1754532397000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-config-nodemgr', 'group': 'contrail-config-nodemgr', 'pid': 48075919711794950873232270529897206058852262543737814349838215330223994666051, 'start': '1754532396000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 08/07/2025 02:06:38.890 7f7d1afbebc8 [contrail-config-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-3765-1.', _node_type='Config', _instance_id='0', _timestamp=1754532398889941, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3765-1.', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-config-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 08/07/2025 02:06:38.890 7f7d1afbebc8 [contrail-config-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-3765-1.', _node_type='Config', _instance_id='0', _timestamp=1754532398890489, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3765-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1754532396000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-schema', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1754532396000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-svc-monitor', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1754532396000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-device-manager', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1754532397000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1754532396000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-08-07 00:45:32.077613", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-10134-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 08/07/2025 02:06:38.893 7f7d21b08a20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:38.894 7f7d21b08a20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-08-07 00:45:32.077613", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-10134-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 8 num_core_per_socket = 8 num_thread_per_core = 1 >> running_package_version = nightly-nightly.el7 installed_package_version = nightly-nightly.el7 >> 08/07/2025 02:06:38.894 7f7d21b08a20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:38.894 7f7d21b08a20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:38.894 7f7d21b08a20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 08/07/2025 02:06:38.895 7f7d21b08a20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:38.895 7f7d21b08a20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:38.895 7f7d21b08a20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. deleted = False process_info = [ << process_name = contrail-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1754532396000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-schema process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1754532396000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-svc-monitor process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1754532396000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-device-manager process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1754532397000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1754532396000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-08-07 00:45:32.077613", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-10134-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 08/07/2025 02:06:38.895 7f7d21b08a20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:42.587 7f7d18570ac8 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:06:42.589 7f7d18570ac8 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:06:42.589 7f7d18570ac8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:06:42.589 7f7d18570ac8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:06:42.589 7f7d18570ac8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:06:42.589 7f7d18570ac8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:06:42.589 7f7d18570ac8 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:06:42.590 7f7d18570ac8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:06:42.590 7f7d18570ac8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:42.590 7f7d18570ac8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:06:42.590 7f7d18570ac8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:42.590 7f7d18570ac8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:42.590 7f7d18570ac8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:06:42.590 7f7d18570ac8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:46.589 7f7d17217240 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:06:46.590 7f7d17217240 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:06:46.591 7f7d17217240 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:06:46.591 7f7d17217240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:06:46.591 7f7d17217240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:06:46.591 7f7d17217240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:06:46.591 7f7d17217240 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:06:46.591 7f7d17217240 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:06:46.592 7f7d17217240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:46.592 7f7d17217240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:06:46.593 7f7d17217240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:46.593 7f7d17217240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:46.593 7f7d17217240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:06:46.593 7f7d17217240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:47.937 7f7d1afbebc8 [contrail-config-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-3765-1.', _node_type='Config', _instance_id='0', _timestamp=1754532407937458, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3765-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1754532396000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-schema', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1754532396000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-svc-monitor', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1754532396000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-device-manager', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1754532397000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1754532396000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-08-07 00:45:32.077613", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-10134-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 08/07/2025 02:06:47.938 7f7d1afbebc8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3765-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14449648, partition_space_available_1k=66640836, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1600, cpu_share=0.0, mem_res=792, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1576, cpu_share=0.0, mem_res=784, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=64148, cpu_share=0.0, mem_res=61836, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=126972, cpu_share=0.0, mem_res=108164, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51860, cpu_share=0.0, mem_res=40064, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=5877352, free=11558964, buffers=664520, cached=14564284, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.19, five_min_avg=1.87, fifteen_min_avg=1.17, cpu_share=0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/07/2025 02:06:47.938 7f7d201de780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:47.938 7f7d201de780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. deleted = False process_info = [ << process_name = contrail-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1754532396000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-schema process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1754532396000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-svc-monitor process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1754532396000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-device-manager process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1754532397000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1754532396000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-08-07 00:45:32.077613", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-10134-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 08/07/2025 02:06:47.938 7f7d201de780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:47.938 7f7d201de780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:47.939 7f7d201de780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 14449648 partition_space_available_1k = 66640836 percentage_partition_space_used = 18 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-api : << mem_virt = 1600 cpu_share = 0.0 mem_res = 792 >>contrail-schema : << mem_virt = 1576 cpu_share = 0.0 mem_res = 784 >>contrail-svc-monitor : << mem_virt = 64148 cpu_share = 0.0 mem_res = 61836 >>contrail-device-manager : << mem_virt = 126972 cpu_share = 0.0 mem_res = 108164 >>contrail-config-nodemgr : << mem_virt = 51860 cpu_share = 0.0 mem_res = 40064 >> } system_mem_usage = << total = 32665120 used = 5877352 free = 11558964 buffers = 664520 cached = 14564284 node_type = config-node >> system_cpu_usage = << one_min_avg = 3.19 five_min_avg = 1.87 fifteen_min_avg = 1.17 cpu_share = 0 node_type = config-node >> >> 08/07/2025 02:06:47.940 7f7d201de780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:50.593 7f7d201de780 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:06:50.594 7f7d201de780 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:06:50.595 7f7d201de780 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:06:50.595 7f7d201de780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:06:50.595 7f7d201de780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:06:50.595 7f7d201de780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:06:50.595 7f7d201de780 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:06:50.595 7f7d201de780 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:06:50.595 7f7d201de780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:50.595 7f7d201de780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:06:50.595 7f7d201de780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:50.596 7f7d201de780 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:50.596 7f7d201de780 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:06:50.596 7f7d201de780 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:54.595 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:06:54.597 7f7d173a5e10 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:06:54.597 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:06:54.597 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:06:54.597 7f7d173a5e10 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:06:54.597 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:06:54.597 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:06:54.598 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:06:54.598 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:54.598 7f7d173a5e10 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:06:54.598 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:54.598 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:54.598 7f7d173a5e10 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:06:54.598 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:58.601 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:06:58.602 7f7d173a5e10 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:06:58.602 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:06:58.602 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:06:58.602 7f7d173a5e10 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:06:58.603 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:06:58.603 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:06:58.603 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:06:58.603 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:58.603 7f7d173a5e10 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:06:58.603 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:58.603 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:06:58.603 7f7d173a5e10 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:06:58.603 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:02.605 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:07:02.606 7f7d173a5e10 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:07:02.606 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:07:02.606 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:02.606 7f7d173a5e10 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:07:02.607 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:02.607 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:07:02.607 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:07:02.607 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:02.607 7f7d173a5e10 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:07:02.607 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:02.607 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:02.607 7f7d173a5e10 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:07:02.607 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:06.608 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:07:06.609 7f7d173a5e10 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:07:06.609 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:07:06.610 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:06.610 7f7d173a5e10 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:07:06.610 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:06.610 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:07:06.610 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:07:06.610 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:06.610 7f7d173a5e10 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:07:06.610 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:06.610 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:06.611 7f7d173a5e10 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:07:06.611 7f7d173a5e10 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:10.612 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:07:10.613 7f7d173bbe10 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:07:10.613 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:07:10.613 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:10.613 7f7d173bbe10 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:07:10.613 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:10.613 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:07:10.614 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:07:10.614 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:10.614 7f7d173bbe10 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:07:10.614 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:10.614 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:10.614 7f7d173bbe10 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:07:10.614 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:14.617 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:07:14.618 7f7d173bbe10 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:07:14.618 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:07:14.618 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:14.618 7f7d173bbe10 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:07:14.619 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:14.619 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:07:14.619 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:07:14.619 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:14.619 7f7d173bbe10 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:07:14.619 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:14.619 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:14.619 7f7d173bbe10 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:07:14.619 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:18.621 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:07:18.622 7f7d173bbe10 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:07:18.622 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:07:18.622 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:18.623 7f7d173bbe10 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:07:18.623 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:18.623 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:07:18.623 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:07:18.623 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:18.623 7f7d173bbe10 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:07:18.623 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:18.623 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:18.623 7f7d173bbe10 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:07:18.623 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:22.626 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:07:22.628 7f7d173bbe10 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:07:22.628 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:07:22.628 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:22.628 7f7d173bbe10 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:07:22.628 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:22.628 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:07:22.629 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:07:22.629 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:22.629 7f7d173bbe10 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:07:22.629 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:22.629 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:22.629 7f7d173bbe10 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:07:22.629 7f7d173bbe10 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:26.629 7f7d17220630 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:07:26.631 7f7d17220630 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:07:26.631 7f7d17220630 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:07:26.631 7f7d17220630 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:26.632 7f7d17220630 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:07:26.632 7f7d17220630 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:26.632 7f7d17220630 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:07:26.632 7f7d17220630 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:07:26.632 7f7d17220630 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:26.632 7f7d17220630 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:07:26.633 7f7d17220630 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:26.633 7f7d17220630 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:26.633 7f7d17220630 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:07:26.633 7f7d17220630 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:30.635 7f7d17220630 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:07:30.636 7f7d17220630 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:07:30.636 7f7d17220630 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:07:30.636 7f7d17220630 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:30.637 7f7d17220630 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:07:30.637 7f7d17220630 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:30.637 7f7d17220630 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:07:30.637 7f7d17220630 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:07:30.637 7f7d17220630 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:30.637 7f7d17220630 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:07:30.637 7f7d17220630 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:30.637 7f7d17220630 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:30.637 7f7d17220630 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:07:30.638 7f7d17220630 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:34.637 7f7d17220630 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:07:34.638 7f7d17220630 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:07:34.638 7f7d17220630 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:07:34.638 7f7d17220630 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:34.639 7f7d17220630 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:07:34.639 7f7d17220630 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:34.639 7f7d17220630 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:07:34.639 7f7d17220630 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:07:34.639 7f7d17220630 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:34.639 7f7d17220630 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:07:34.639 7f7d17220630 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:34.639 7f7d17220630 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:34.639 7f7d17220630 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:07:34.639 7f7d17220630 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:38.641 7f7d17220630 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:07:38.642 7f7d17220630 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:07:38.642 7f7d17220630 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:07:38.642 7f7d17220630 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:38.642 7f7d17220630 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:07:38.643 7f7d17220630 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:38.643 7f7d17220630 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:07:38.643 7f7d17220630 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:07:38.643 7f7d17220630 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:38.643 7f7d17220630 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:07:38.643 7f7d17220630 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:38.643 7f7d17220630 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:38.643 7f7d17220630 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:07:38.643 7f7d17220630 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:42.644 7f7d185b9978 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:07:42.646 7f7d185b9978 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:07:42.646 7f7d185b9978 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:07:42.646 7f7d185b9978 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:42.646 7f7d185b9978 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:07:42.646 7f7d185b9978 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:42.646 7f7d185b9978 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:07:42.647 7f7d185b9978 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:07:42.647 7f7d185b9978 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:42.647 7f7d185b9978 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:07:42.647 7f7d185b9978 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:42.647 7f7d185b9978 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:42.647 7f7d185b9978 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:07:42.647 7f7d185b9978 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:46.647 7f7d17217828 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:07:46.648 7f7d17217828 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:07:46.648 7f7d17217828 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:07:46.648 7f7d17217828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:46.648 7f7d17217828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:07:46.648 7f7d17217828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:46.649 7f7d17217828 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:07:46.649 7f7d17217828 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:07:46.649 7f7d17217828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:46.649 7f7d17217828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:07:46.649 7f7d17217828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:46.649 7f7d17217828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:46.649 7f7d17217828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:07:46.649 7f7d17217828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:47.932 7f7d1afbebc8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3765-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15118420, partition_space_available_1k=65972064, percentage_partition_space_used=19, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=100820, cpu_share=0.19, mem_res=95412, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81632, cpu_share=0.06, mem_res=77300, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=89924, cpu_share=0.05, mem_res=85444, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196928, cpu_share=0.08, mem_res=174400, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51912, cpu_share=0.01, mem_res=40064, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=6359348, free=10346452, buffers=683644, cached=15275676, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.49, five_min_avg=2.21, fifteen_min_avg=1.33, cpu_share=3.75, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/07/2025 02:07:47.933 7f7d1b028630 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:47.933 7f7d1b028630 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 15118420 partition_space_available_1k = 65972064 percentage_partition_space_used = 19 >> } process_mem_cpu_usage = { contrail-api : << mem_virt = 100820 cpu_share = 0.19 mem_res = 95412 >>contrail-schema : << mem_virt = 81632 cpu_share = 0.06 mem_res = 77300 >>contrail-svc-monitor : << mem_virt = 89924 cpu_share = 0.05 mem_res = 85444 >>contrail-device-manager : << mem_virt = 196928 cpu_share = 0.08 mem_res = 174400 >>contrail-config-nodemgr : << mem_virt = 51912 cpu_share = 0.01 mem_res = 40064 >> } system_mem_usage = << total = 32665120 used = 6359348 free = 10346452 buffers = 683644 cached = 15275676 node_type = config-node >> system_cpu_usage = << one_min_avg = 3.49 five_min_avg = 2.21 fifteen_min_avg = 1.33 cpu_share = 3.75 node_type = config-node >> >> 08/07/2025 02:07:47.933 7f7d1b028630 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:50.652 7f7d1b028630 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:07:50.653 7f7d1b028630 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:07:50.653 7f7d1b028630 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:07:50.653 7f7d1b028630 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:50.654 7f7d1b028630 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:07:50.654 7f7d1b028630 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:50.654 7f7d1b028630 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:07:50.654 7f7d1b028630 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:07:50.655 7f7d1b028630 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:50.655 7f7d1b028630 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:07:50.655 7f7d1b028630 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:50.655 7f7d1b028630 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:50.655 7f7d1b028630 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:07:50.655 7f7d1b028630 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:54.656 7f7d173a5eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:07:54.659 7f7d173a5eb8 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:07:54.660 7f7d173a5eb8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:07:54.660 7f7d173a5eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:54.660 7f7d173a5eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:07:54.660 7f7d173a5eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:54.660 7f7d173a5eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:07:54.660 7f7d173a5eb8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:07:54.660 7f7d173a5eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:54.660 7f7d173a5eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:07:54.661 7f7d173a5eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:54.661 7f7d173a5eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:54.661 7f7d173a5eb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:07:54.661 7f7d173a5eb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:58.664 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:07:58.665 7f7d173a5d68 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:07:58.665 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:07:58.666 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:58.666 7f7d173a5d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:07:58.666 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:07:58.666 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:07:58.666 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:07:58.667 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:58.667 7f7d173a5d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:07:58.667 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:58.667 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:07:58.667 7f7d173a5d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:07:58.667 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:02.669 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:08:02.671 7f7d173a5d68 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:08:02.671 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:08:02.671 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:08:02.671 7f7d173a5d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:08:02.671 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:08:02.671 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:08:02.671 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:08:02.672 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:02.672 7f7d173a5d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:08:02.672 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:02.672 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:02.672 7f7d173a5d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:08:02.672 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:06.675 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:08:06.676 7f7d173a5d68 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:08:06.677 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:08:06.677 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:08:06.677 7f7d173a5d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:08:06.677 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:08:06.677 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:08:06.677 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:08:06.677 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:06.677 7f7d173a5d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:08:06.678 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:06.678 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:06.678 7f7d173a5d68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:08:06.678 7f7d173a5d68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:10.678 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:08:10.679 7f7d185746d8 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:08:10.680 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:08:10.680 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:08:10.680 7f7d185746d8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:08:10.680 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:08:10.680 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:08:10.681 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:08:10.681 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:10.681 7f7d185746d8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:08:10.681 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:10.681 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:10.681 7f7d185746d8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:08:10.681 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:14.684 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:08:14.685 7f7d185746d8 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:08:14.685 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:08:14.685 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:08:14.685 7f7d185746d8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:08:14.685 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:08:14.686 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:08:14.686 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:08:14.686 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:14.686 7f7d185746d8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:08:14.686 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:14.686 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:14.687 7f7d185746d8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:08:14.687 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:18.685 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:08:18.686 7f7d185746d8 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:08:18.686 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:08:18.686 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:08:18.686 7f7d185746d8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:08:18.687 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:08:18.687 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:08:18.687 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:08:18.687 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:18.687 7f7d185746d8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:08:18.687 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:18.687 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:18.687 7f7d185746d8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:08:18.687 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:22.690 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:08:22.691 7f7d185746d8 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:08:22.692 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:08:22.692 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:08:22.692 7f7d185746d8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:08:22.692 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:08:22.692 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:08:22.692 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:08:22.692 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:22.692 7f7d185746d8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:08:22.692 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:22.692 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:22.693 7f7d185746d8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:08:22.693 7f7d185746d8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:26.693 7f7d18569828 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:08:26.694 7f7d18569828 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:08:26.694 7f7d18569828 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:08:26.694 7f7d18569828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:08:26.695 7f7d18569828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:08:26.695 7f7d18569828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:08:26.695 7f7d18569828 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:08:26.695 7f7d18569828 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:08:26.695 7f7d18569828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:26.695 7f7d18569828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:08:26.695 7f7d18569828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:26.695 7f7d18569828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:26.695 7f7d18569828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:08:26.695 7f7d18569828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:30.697 7f7d18569828 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:08:30.698 7f7d18569828 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:08:30.698 7f7d18569828 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:08:30.698 7f7d18569828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:08:30.699 7f7d18569828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:08:30.699 7f7d18569828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:08:30.699 7f7d18569828 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:08:30.699 7f7d18569828 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:08:30.699 7f7d18569828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:30.699 7f7d18569828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:08:30.699 7f7d18569828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:30.699 7f7d18569828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:30.700 7f7d18569828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:08:30.700 7f7d18569828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:34.701 7f7d18569828 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:08:34.702 7f7d18569828 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:08:34.702 7f7d18569828 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:08:34.702 7f7d18569828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:08:34.703 7f7d18569828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:08:34.703 7f7d18569828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:08:34.703 7f7d18569828 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:08:34.703 7f7d18569828 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:08:34.703 7f7d18569828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:34.703 7f7d18569828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:08:34.703 7f7d18569828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:34.703 7f7d18569828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:34.704 7f7d18569828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:08:34.704 7f7d18569828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:38.705 7f7d18569828 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:08:38.706 7f7d18569828 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:08:38.706 7f7d18569828 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:08:38.706 7f7d18569828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:08:38.707 7f7d18569828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:08:38.707 7f7d18569828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:08:38.707 7f7d18569828 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:08:38.707 7f7d18569828 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:08:38.707 7f7d18569828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:38.707 7f7d18569828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:08:38.707 7f7d18569828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:38.707 7f7d18569828 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:38.707 7f7d18569828 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:08:38.707 7f7d18569828 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:42.708 7f7d18570438 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:08:42.710 7f7d18570438 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:08:42.710 7f7d18570438 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:08:42.710 7f7d18570438 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:08:42.710 7f7d18570438 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:08:42.710 7f7d18570438 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:08:42.710 7f7d18570438 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:08:42.711 7f7d18570438 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:08:42.711 7f7d18570438 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:42.711 7f7d18570438 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:08:42.711 7f7d18570438 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:42.711 7f7d18570438 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:42.711 7f7d18570438 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:08:42.711 7f7d18570438 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:46.712 7f7d1854beb8 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:08:46.713 7f7d1854beb8 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:08:46.713 7f7d1854beb8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:08:46.713 7f7d1854beb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:08:46.713 7f7d1854beb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:08:46.713 7f7d1854beb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:08:46.713 7f7d1854beb8 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:08:46.714 7f7d1854beb8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:08:46.714 7f7d1854beb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:46.714 7f7d1854beb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:08:46.714 7f7d1854beb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:46.714 7f7d1854beb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:46.714 7f7d1854beb8 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:08:46.714 7f7d1854beb8 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:47.938 7f7d1afbebc8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3765-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=16059216, partition_space_available_1k=65031268, percentage_partition_space_used=20, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=101476, cpu_share=0.03, mem_res=95848, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81856, cpu_share=0.0, mem_res=77428, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=90012, cpu_share=0.0, mem_res=85444, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=198112, cpu_share=0.02, mem_res=175408, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51960, cpu_share=0.01, mem_res=40064, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=7789960, free=8096148, buffers=704500, cached=16074512, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.68, five_min_avg=2.22, fifteen_min_avg=1.39, cpu_share=3.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/07/2025 02:08:47.939 7f7d1857db70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:47.939 7f7d1857db70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 16059216 partition_space_available_1k = 65031268 percentage_partition_space_used = 20 >> } process_mem_cpu_usage = { contrail-api : << mem_virt = 101476 cpu_share = 0.03 mem_res = 95848 >>contrail-schema : << mem_virt = 81856 cpu_share = 0.0 mem_res = 77428 >>contrail-svc-monitor : << mem_virt = 90012 cpu_share = 0.0 mem_res = 85444 >>contrail-device-manager : << mem_virt = 198112 cpu_share = 0.02 mem_res = 175408 >>contrail-config-nodemgr : << mem_virt = 51960 cpu_share = 0.01 mem_res = 40064 >> } system_mem_usage = << total = 32665120 used = 7789960 free = 8096148 buffers = 704500 cached = 16074512 node_type = config-node >> system_cpu_usage = << one_min_avg = 2.68 five_min_avg = 2.22 fifteen_min_avg = 1.39 cpu_share = 3.25 node_type = config-node >> >> 08/07/2025 02:08:47.939 7f7d1857db70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:50.716 7f7d1857db70 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:08:50.717 7f7d1857db70 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 08/07/2025 02:08:50.717 7f7d1857db70 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:08:50.718 7f7d1857db70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:08:50.718 7f7d1857db70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:08:50.718 7f7d1857db70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:08:50.718 7f7d1857db70 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/07/2025 02:08:50.718 7f7d1857db70 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/07/2025 02:08:50.718 7f7d1857db70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:50.718 7f7d1857db70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/07/2025 02:08:50.718 7f7d1857db70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:50.718 7f7d1857db70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:50.719 7f7d1857db70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1754532398587583 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 08/07/2025 02:08:50.719 7f7d1857db70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/07/2025 02:08:54.721 7f7d1857db70 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/07/2025 02:08:54.722 7f7d1857db70 [contrail-config-nodemgr] [INFO]: Session Event: TCP Connected 08/07/2025 02:08:54.722 7f7d1857db70 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/07/2025 02:08:54.723 7f7d1857db70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:08:54.723 7f7d1857db70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3765-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/07/2025 02:08:54.723 7f7d1857db70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/07/2025 02:08:54.723 7f7d1857db70 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 08/07/2025 02:08:54.723 7f7d1857db70 [contrail-config-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 08/07/2025 02:08:54.723 7f7d1857db70 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 08/07/2025 02:08:54.723 7f7d1857db70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 08/07/2025 02:08:54.723 7f7d1857db70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 08/07/2025 02:09:03.700 7f7d1857d198 [contrail-config-nodemgr] [DEBUG]: Extracted sandesh length: 0000001016 08/07/2025 02:09:03.701 7f7d1857d198 [contrail-config-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 08/07/2025 02:09:03.701 7f7d18c71240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 08/07/2025 02:09:03.701 7f7d18c71240 [contrail-config-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 08/07/2025 02:09:03.702 7f7d18c71240 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/07/2025 02:09:03.702 7f7d18c71240 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 08/07/2025 02:09:03.702 7f7d18c71240 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 08/07/2025 02:09:03.702 7f7d1ab05588 [contrail-config-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 08/07/2025 02:09:03.703 7f7d1ab05588 [contrail-config-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 08/07/2025 02:09:13.737 7f7d1857d198 [contrail-config-nodemgr] [DEBUG]: Extracted sandesh length: 0000001296 08/07/2025 02:09:13.738 7f7d1857d198 [contrail-config-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 08/07/2025 02:09:13.738 7f7d185b9198 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 08/07/2025 02:09:13.738 7f7d185b9198 [contrail-config-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 08/07/2025 02:09:13.738 7f7d185b9198 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/07/2025 02:09:13.738 7f7d185b9198 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 08/07/2025 02:09:47.958 7f7d1afbebc8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3765-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=17528708, partition_space_available_1k=63561776, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=101608, cpu_share=0.0, mem_res=95928, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81920, cpu_share=0.0, mem_res=77488, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=90008, cpu_share=0.0, mem_res=85436, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=198116, cpu_share=0.0, mem_res=175400, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52128, cpu_share=0.01, mem_res=40240, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=8984260, free=5013284, buffers=744564, cached=17923012, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.95, five_min_avg=2.97, fifteen_min_avg=1.7, cpu_share=5.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/07/2025 02:10:47.971 7f7d1afbebc8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3765-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=17817612, partition_space_available_1k=63272872, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=99580, cpu_share=0.0, mem_res=95928, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=80460, cpu_share=0.0, mem_res=77488, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=88276, cpu_share=0.0, mem_res=85436, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=179300, cpu_share=0.0, mem_res=175400, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42788, cpu_share=0.01, mem_res=40300, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9027256, free=20185964, buffers=748608, cached=2703292, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.7, five_min_avg=2.97, fifteen_min_avg=1.79, cpu_share=4.12, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/07/2025 02:11:47.987 7f7d1afbebc8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3765-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=17819628, partition_space_available_1k=63270856, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=99600, cpu_share=0.0, mem_res=95928, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=80460, cpu_share=0.0, mem_res=77488, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=88288, cpu_share=0.0, mem_res=85436, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=179312, cpu_share=0.0, mem_res=175400, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42660, cpu_share=0.01, mem_res=40320, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9561792, free=19691540, buffers=751700, cached=2660088, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.82, five_min_avg=2.84, fifteen_min_avg=1.81, cpu_share=2.62, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/07/2025 02:12:04.755 7f7d1aacd978 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/07/2025 02:12:07.104 7f7d1aacd978 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/07/2025 02:12:47.982 7f7d1afbebc8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3765-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18255900, partition_space_available_1k=62834584, percentage_partition_space_used=23, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=99644, cpu_share=0.0, mem_res=95928, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=80548, cpu_share=0.0, mem_res=77568, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=88288, cpu_share=0.0, mem_res=85440, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=179328, cpu_share=0.0, mem_res=175404, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42744, cpu_share=0.01, mem_res=40372, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9690800, free=18596384, buffers=758100, cached=3619836, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.3, five_min_avg=3.03, fifteen_min_avg=1.95, cpu_share=3.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/07/2025 02:13:47.998 7f7d1afbebc8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3765-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18576328, partition_space_available_1k=62514156, percentage_partition_space_used=23, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=102360, cpu_share=0.04, mem_res=97904, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82364, cpu_share=0.01, mem_res=78080, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=88816, cpu_share=0.01, mem_res=85440, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=179924, cpu_share=0.01, mem_res=175404, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42780, cpu_share=0.01, mem_res=40408, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9823540, free=18164480, buffers=768192, cached=3908908, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.18, five_min_avg=3.34, fifteen_min_avg=2.12, cpu_share=4.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/07/2025 02:14:47.999 7f7d1afbebc8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3765-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18622012, partition_space_available_1k=62468472, percentage_partition_space_used=23, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=111600, cpu_share=0.32, mem_res=102412, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=85456, cpu_share=0.07, mem_res=79100, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=92056, cpu_share=0.06, mem_res=85444, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=182116, cpu_share=0.04, mem_res=175832, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42788, cpu_share=0.01, mem_res=40408, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9927300, free=18016556, buffers=768244, cached=3953020, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.31, five_min_avg=3.85, fifteen_min_avg=2.37, cpu_share=5.62, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/07/2025 02:15:48.009 7f7d1afbebc8 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-3765-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=18662452, partition_space_available_1k=62428032, percentage_partition_space_used=23, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=125028, cpu_share=0.32, mem_res=109096, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=87272, cpu_share=0.06, mem_res=79308, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=93684, cpu_share=0.04, mem_res=85496, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=183664, cpu_share=0.03, mem_res=175932, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42788, cpu_share=0.01, mem_res=40408, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9857420, free=18047184, buffers=768328, cached=3992188, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.8, five_min_avg=4.27, fifteen_min_avg=2.61, cpu_share=5.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 08/07/2025 02:15:54.996 7f7d188c12e8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map