09/29/2025 04:56:24.508 7facc3d6fdf0 [contrail-config-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 09/29/2025 04:56:24.508 7facc3d6fdf0 [contrail-config-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 09/29/2025 04:56:24.508 7facc3d6fdf0 [contrail-config-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 09/29/2025 04:56:24.515 7facbe60e548 [contrail-config-nodemgr] [ERROR]: Cannot write http_port 8100 to /tmp/contrail-config-nodemgr.0.http_port 09/29/2025 04:56:24.515 7facbe60e548 [contrail-config-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8100 09/29/2025 04:56:24.516 7facbe60ed48 [contrail-config-nodemgr] [INFO]: Processing event[EvStart] in state[none] 09/29/2025 04:56:24.517 7facbe60ed48 [contrail-config-nodemgr] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 09/29/2025 04:56:24.517 7facbe60ed48 [contrail-config-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/29/2025 04:56:24.517 7facbe60ed48 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 09/29/2025 04:56:24.517 7facbe60ed48 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:24.518 7facbe60ed48 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/29/2025 04:56:24.518 7facbe60ed48 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:24.518 7facbe60ed48 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:24.518 7facbe60ed48 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 09/29/2025 04:56:24.518 7facbe60ed48 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:24.625 7facc3d6fdf0 [contrail-config-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-api', 'group': 'contrail-api', 'pid': 29621757834749110380681367596033699508464805131066137401872027546713974335138, 'start': '1759121782000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-schema', 'group': 'contrail-schema', 'pid': 14745409174006526200338073352914576447853096457818504615721343888408552028090, 'start': '1759121782000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-svc-monitor', 'group': 'contrail-svc-monitor', 'pid': 108045953921597185714348001281207088974770651401130173705758238934256314484727, 'start': '1759121782000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-device-manager', 'group': 'contrail-device-manager', 'pid': 30855717328519406993189319701934784348761904220051091029623274627506812712780, 'start': '1759121783000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-config-nodemgr', 'group': 'contrail-config-nodemgr', 'pid': 28792999786400523047428516405092884678064765155336055164456306957000851738387, 'start': '1759121782000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 09/29/2025 04:56:24.805 7facc3d6fdf0 [contrail-config-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-4204-1.', _node_type='Config', _instance_id='0', _timestamp=1759121784805743, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4204-1.', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-config-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 09/29/2025 04:56:24.806 7facc3d6fdf0 [contrail-config-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-4204-1.', _node_type='Config', _instance_id='0', _timestamp=1759121784806340, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4204-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1759121782000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-schema', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1759121782000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-svc-monitor', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1759121782000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-device-manager', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1759121783000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1759121782000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "v0+nightly.r24.1.centos", "build-time" : "2025-09-29 01:05:21.182320", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-11321-1.novalocal", "build-id" : "v0+nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 09/29/2025 04:56:24.809 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:24.810 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. build_info = {"build-info" : [{"build-version" : "v0+nightly.r24.1.centos", "build-time" : "2025-09-29 01:05:21.182320", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-11321-1.novalocal", "build-id" : "v0+nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 4 num_core_per_socket = 4 num_thread_per_core = 1 >> running_package_version = v0+nightly.r24.1.centos-nightly_r24.1_centos.el7 installed_package_version = v0+nightly.r24.1.centos-nightly_r24.1_centos.el7 >> 09/29/2025 04:56:24.810 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:24.810 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:24.811 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/29/2025 04:56:24.811 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:24.811 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:24.811 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. deleted = False process_info = [ << process_name = contrail-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1759121782000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-schema process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1759121782000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-svc-monitor process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1759121782000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-device-manager process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1759121783000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1759121782000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "v0+nightly.r24.1.centos", "build-time" : "2025-09-29 01:05:21.182320", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-11321-1.novalocal", "build-id" : "v0+nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} >> 09/29/2025 04:56:24.811 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:28.517 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:56:28.522 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:56:28.525 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:56:28.525 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:56:28.525 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:56:28.525 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:56:28.525 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:56:28.526 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:56:28.526 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:28.526 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:56:28.526 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:28.526 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:28.526 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:56:28.526 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:32.522 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:56:32.590 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:56:32.591 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:56:32.591 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:56:32.591 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:56:32.591 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:56:32.591 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:56:32.591 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:56:32.591 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:32.592 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:56:32.592 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:32.592 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:32.592 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:56:32.592 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:33.869 7facc3d6fdf0 [contrail-config-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-4204-1.', _node_type='Config', _instance_id='0', _timestamp=1759121793869544, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4204-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1759121782000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-schema', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1759121782000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-svc-monitor', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1759121782000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-device-manager', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1759121783000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1759121782000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "v0+nightly.r24.1.centos", "build-time" : "2025-09-29 01:05:21.182320", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-11321-1.novalocal", "build-id" : "v0+nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 09/29/2025 04:56:33.870 7facc3d6fdf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4204-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=13100500, partition_space_available_1k=67989984, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1608, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=4572, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=57012, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84952, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50596, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5965792, free=304332, buffers=628936, cached=9663044, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.18, five_min_avg=2.28, fifteen_min_avg=1.33, cpu_share=0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 09/29/2025 04:56:33.870 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:33.870 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. deleted = False process_info = [ << process_name = contrail-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1759121782000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-schema process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1759121782000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-svc-monitor process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1759121782000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-device-manager process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1759121783000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1759121782000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "v0+nightly.r24.1.centos", "build-time" : "2025-09-29 01:05:21.182320", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-11321-1.novalocal", "build-id" : "v0+nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} >> 09/29/2025 04:56:33.870 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:33.870 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:33.870 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 13100500 partition_space_available_1k = 67989984 percentage_partition_space_used = 16 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-api : << mem_virt = 1608 cpu_share = 0 mem_res = 0 >>contrail-schema : << mem_virt = 4572 cpu_share = 0 mem_res = 0 >>contrail-svc-monitor : << mem_virt = 57012 cpu_share = 0 mem_res = 0 >>contrail-device-manager : << mem_virt = 84952 cpu_share = 0 mem_res = 0 >>contrail-config-nodemgr : << mem_virt = 50596 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 16175640 used = 5965792 free = 304332 buffers = 628936 cached = 9663044 node_type = config-node >> system_cpu_usage = << one_min_avg = 4.18 five_min_avg = 2.28 fifteen_min_avg = 1.33 cpu_share = 0 node_type = config-node >> >> 09/29/2025 04:56:33.870 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:36.592 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:56:36.593 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:56:36.594 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:56:36.594 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:56:36.594 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:56:36.594 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:56:36.594 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:56:36.594 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:56:36.594 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:36.595 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:56:36.595 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:36.595 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:36.595 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:56:36.595 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:40.594 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:56:40.596 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:56:40.596 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:56:40.596 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:56:40.596 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:56:40.596 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:56:40.596 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:56:40.597 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:56:40.597 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:40.597 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:56:40.597 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:40.597 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:40.597 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:56:40.597 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:44.596 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:56:44.597 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:56:44.598 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:56:44.598 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:56:44.598 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:56:44.598 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:56:44.598 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:56:44.598 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:56:44.598 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:44.598 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:56:44.598 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:44.598 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:44.599 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:56:44.599 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:48.600 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:56:48.601 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:56:48.602 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:56:48.602 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:56:48.602 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:56:48.602 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:56:48.602 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:56:48.602 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:56:48.602 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:48.602 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:56:48.602 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:48.602 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:48.603 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:56:48.603 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:52.604 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:56:52.606 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:56:52.606 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:56:52.606 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:56:52.606 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:56:52.606 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:56:52.606 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:56:52.606 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:56:52.606 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:52.607 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:56:52.607 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:52.607 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:52.607 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:56:52.607 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:56.607 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:56:56.608 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:56:56.608 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:56:56.608 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:56:56.608 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:56:56.608 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:56:56.608 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:56:56.609 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:56:56.609 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:56.609 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:56:56.609 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:56.609 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:56:56.609 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:56:56.609 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:00.612 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:57:00.613 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:57:00.613 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:57:00.613 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:00.614 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:57:00.614 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:00.614 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:57:00.614 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:57:00.614 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:00.614 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:57:00.614 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:00.614 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:00.614 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:57:00.614 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:04.616 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:57:04.618 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:57:04.618 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:57:04.618 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:04.618 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:57:04.618 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:04.618 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:57:04.619 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:57:04.619 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:04.619 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:57:04.619 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:04.619 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:04.619 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:57:04.619 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:08.620 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:57:08.621 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:57:08.622 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:57:08.622 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:08.622 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:57:08.622 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:08.622 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:57:08.622 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:57:08.622 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:08.622 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:57:08.622 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:08.622 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:08.622 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:57:08.622 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:12.622 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:57:12.623 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:57:12.624 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:57:12.624 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:12.624 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:57:12.624 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:12.624 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:57:12.624 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:57:12.624 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:12.624 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:57:12.624 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:12.624 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:12.624 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:57:12.625 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:16.624 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:57:16.625 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:57:16.626 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:57:16.626 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:16.626 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:57:16.626 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:16.626 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:57:16.626 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:57:16.626 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:16.626 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:57:16.626 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:16.626 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:16.626 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:57:16.626 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:20.628 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:57:20.632 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:57:20.632 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:57:20.632 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:20.633 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:57:20.633 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:20.633 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:57:20.633 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:57:20.633 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:20.633 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:57:20.633 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:20.633 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:20.633 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:57:20.633 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:24.632 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:57:24.633 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:57:24.634 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:57:24.634 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:24.634 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:57:24.634 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:24.634 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:57:24.634 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:57:24.634 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:24.634 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:57:24.634 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:24.634 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:24.634 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:57:24.634 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:28.634 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:57:28.636 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:57:28.636 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:57:28.636 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:28.636 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:57:28.636 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:28.636 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:57:28.637 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:57:28.637 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:28.637 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:57:28.637 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:28.637 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:28.637 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:57:28.637 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:32.636 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:57:32.638 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:57:32.638 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:57:32.638 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:32.638 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:57:32.638 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:32.639 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:57:32.639 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:57:32.639 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:32.639 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:57:32.639 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:32.639 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:32.639 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:57:32.639 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:33.895 7facc3d6fdf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4204-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=13506844, partition_space_available_1k=67583640, percentage_partition_space_used=17, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=96300, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=72616, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69884, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84560, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50500, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6581336, free=294912, buffers=636808, cached=9049388, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.06, five_min_avg=2.82, fifteen_min_avg=1.57, cpu_share=19.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 09/29/2025 04:57:33.895 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:33.895 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 13506844 partition_space_available_1k = 67583640 percentage_partition_space_used = 17 >> } process_mem_cpu_usage = { contrail-api : << mem_virt = 96300 cpu_share = 0 mem_res = 0 >>contrail-schema : << mem_virt = 72616 cpu_share = 0 mem_res = 0 >>contrail-svc-monitor : << mem_virt = 69884 cpu_share = 0 mem_res = 0 >>contrail-device-manager : << mem_virt = 84560 cpu_share = 0 mem_res = 0 >>contrail-config-nodemgr : << mem_virt = 50500 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 16175640 used = 6581336 free = 294912 buffers = 636808 cached = 9049388 node_type = config-node >> system_cpu_usage = << one_min_avg = 5.06 five_min_avg = 2.82 fifteen_min_avg = 1.57 cpu_share = 19.5 node_type = config-node >> >> 09/29/2025 04:57:33.896 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:36.638 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:57:36.640 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:57:36.640 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:57:36.640 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:36.640 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:57:36.640 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:36.640 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:57:36.640 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:57:36.640 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:36.641 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:57:36.641 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:36.641 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:36.641 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:57:36.641 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:40.643 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:57:40.648 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:57:40.648 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:57:40.648 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:40.648 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:57:40.648 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:40.648 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:57:40.649 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:57:40.649 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:40.649 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:57:40.649 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:40.649 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:40.649 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:57:40.649 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:44.649 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:57:44.651 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:57:44.651 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:57:44.651 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:44.651 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:57:44.651 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:44.651 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:57:44.651 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:57:44.651 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:44.652 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:57:44.652 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:44.652 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:44.652 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:57:44.652 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:48.654 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:57:48.655 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:57:48.655 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:57:48.655 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:48.656 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:57:48.656 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:48.656 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:57:48.656 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:57:48.656 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:48.656 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:57:48.656 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:48.656 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:48.656 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:57:48.656 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:52.657 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:57:52.658 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:57:52.658 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:57:52.658 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:52.658 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:57:52.658 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:52.659 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:57:52.659 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:57:52.659 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:52.659 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:57:52.659 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:52.659 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:52.659 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:57:52.659 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:56.659 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:57:56.666 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:57:56.667 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:57:56.667 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:56.667 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:57:56.667 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:57:56.667 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:57:56.668 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:57:56.668 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:56.668 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:57:56.668 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:56.668 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:57:56.668 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:57:56.668 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:00.668 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:58:00.669 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:58:00.670 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:58:00.670 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:58:00.670 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:58:00.670 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:58:00.670 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:58:00.670 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:58:00.670 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:00.670 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:58:00.670 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:00.670 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:00.670 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:58:00.671 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:04.672 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:58:04.674 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:58:04.674 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:58:04.674 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:58:04.674 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:58:04.674 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:58:04.674 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:58:04.674 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:58:04.674 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:04.675 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:58:04.675 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:04.675 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:04.675 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:58:04.675 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:08.676 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:58:08.679 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:58:08.679 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:58:08.679 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:58:08.679 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:58:08.679 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:58:08.679 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:58:08.680 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:58:08.680 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:08.680 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:58:08.680 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:08.680 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:08.680 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:58:08.680 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:12.679 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:58:12.680 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:58:12.681 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:58:12.681 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:58:12.681 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:58:12.681 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:58:12.681 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:58:12.681 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:58:12.681 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:12.681 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:58:12.681 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:12.682 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:12.682 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:58:12.682 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:16.682 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:58:16.684 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:58:16.684 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:58:16.684 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:58:16.684 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:58:16.684 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:58:16.684 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:58:16.685 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:58:16.685 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:16.685 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:58:16.685 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:16.685 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:16.685 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:58:16.685 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:20.685 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:58:20.692 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:58:20.692 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:58:20.692 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:58:20.692 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:58:20.692 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:58:20.692 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:58:20.693 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:58:20.693 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:20.693 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:58:20.693 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:20.693 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:20.693 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:58:20.693 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:24.692 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:58:24.693 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:58:24.693 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:58:24.694 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:58:24.694 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:58:24.694 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:58:24.694 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:58:24.694 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:58:24.694 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:24.694 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:58:24.694 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:24.694 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:24.694 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:58:24.694 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:28.694 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:58:28.696 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:58:28.696 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:58:28.696 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:58:28.697 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:58:28.697 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:58:28.697 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:58:28.697 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:58:28.697 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:28.697 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:58:28.697 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:28.697 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:28.698 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:58:28.698 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:32.696 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:58:32.699 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:58:32.699 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:58:32.699 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:58:32.699 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:58:32.699 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:58:32.699 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:58:32.699 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:58:32.699 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:32.700 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:58:32.700 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:32.700 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:32.700 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:58:32.700 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:33.854 7facc3d6fdf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4204-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=13922568, partition_space_available_1k=67167916, percentage_partition_space_used=17, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=103688, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=73800, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69936, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84096, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50476, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=7855216, free=465984, buffers=661996, cached=7582976, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.59, five_min_avg=3.41, fifteen_min_avg=1.86, cpu_share=19.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 09/29/2025 04:58:33.854 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:33.854 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 13922568 partition_space_available_1k = 67167916 percentage_partition_space_used = 17 >> } process_mem_cpu_usage = { contrail-api : << mem_virt = 103688 cpu_share = 0 mem_res = 0 >>contrail-schema : << mem_virt = 73800 cpu_share = 0 mem_res = 0 >>contrail-svc-monitor : << mem_virt = 69936 cpu_share = 0 mem_res = 0 >>contrail-device-manager : << mem_virt = 84096 cpu_share = 0 mem_res = 0 >>contrail-config-nodemgr : << mem_virt = 50476 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 16175640 used = 7855216 free = 465984 buffers = 661996 cached = 7582976 node_type = config-node >> system_cpu_usage = << one_min_avg = 5.59 five_min_avg = 3.41 fifteen_min_avg = 1.86 cpu_share = 19.25 node_type = config-node >> >> 09/29/2025 04:58:33.855 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:36.700 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:58:36.707 7facbe205248 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/29/2025 04:58:36.708 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:58:36.708 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:58:36.708 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:58:36.708 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:58:36.708 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/29/2025 04:58:36.708 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/29/2025 04:58:36.708 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:36.708 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/29/2025 04:58:36.708 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:36.709 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:36.709 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1759121784517694 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/29/2025 04:58:36.709 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/29/2025 04:58:40.711 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/29/2025 04:58:40.712 7facbe205248 [contrail-config-nodemgr] [INFO]: Session Event: TCP Connected 09/29/2025 04:58:40.713 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/29/2025 04:58:40.713 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:58:40.713 7facbe205248 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4204-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/29/2025 04:58:40.713 7facbe205248 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/29/2025 04:58:40.713 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/29/2025 04:58:40.713 7facbe205248 [contrail-config-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/29/2025 04:58:40.714 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/29/2025 04:58:40.714 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/29/2025 04:58:40.714 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/29/2025 04:58:49.084 7facbe4aa248 [contrail-config-nodemgr] [DEBUG]: Extracted sandesh length: 0000001016 09/29/2025 04:58:49.084 7facbe4aa248 [contrail-config-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 09/29/2025 04:58:49.085 7facbe205248 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 09/29/2025 04:58:49.085 7facbe205248 [contrail-config-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 09/29/2025 04:58:49.085 7facbe205248 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/29/2025 04:58:49.085 7facbe205248 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/29/2025 04:58:49.085 7facbe205248 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 09/29/2025 04:58:49.085 7facbe60ee48 [contrail-config-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/29/2025 04:58:49.086 7facbe60ee48 [contrail-config-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/29/2025 04:58:59.066 7facbe4aa248 [contrail-config-nodemgr] [DEBUG]: Extracted sandesh length: 0000001296 09/29/2025 04:58:59.067 7facbe4aa248 [contrail-config-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 09/29/2025 04:58:59.068 7facbe60ee48 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 09/29/2025 04:58:59.068 7facbe60ee48 [contrail-config-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 09/29/2025 04:58:59.069 7facbe60ee48 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/29/2025 04:58:59.069 7facbe60ee48 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/29/2025 04:59:33.867 7facc3d6fdf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4204-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14355612, partition_space_available_1k=66734872, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104048, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=73828, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69920, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83856, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50588, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=9130616, free=303804, buffers=675624, cached=6453416, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.98, five_min_avg=4.36, fifteen_min_avg=2.29, cpu_share=18.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 09/29/2025 05:00:33.867 7facc3d6fdf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4204-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14426636, partition_space_available_1k=66663848, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104048, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=73828, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69920, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83856, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50624, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=8920188, free=445788, buffers=675956, cached=6521392, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.59, five_min_avg=4.19, fifteen_min_avg=2.37, cpu_share=15.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 09/29/2025 05:00:59.231 7facbe60ee48 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/29/2025 05:01:33.883 7facc3d6fdf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4204-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14902808, partition_space_available_1k=66187676, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104120, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=73952, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69920, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83856, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50708, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=8946332, free=444012, buffers=680588, cached=6492356, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.23, five_min_avg=4.17, fifteen_min_avg=2.47, cpu_share=15.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 09/29/2025 05:01:36.452 7facbe205248 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/29/2025 05:02:33.882 7facc3d6fdf0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-4204-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15244420, partition_space_available_1k=65846064, percentage_partition_space_used=19, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=104728, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=73952, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69920, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83852, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50720, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=8959908, free=522800, buffers=690460, cached=6390136, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.85, five_min_avg=4.35, fifteen_min_avg=2.65, cpu_share=15.75, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 09/29/2025 05:02:50.229 7facbe60ee48 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map