01/20/2025 02:11:03.324 7f2d407e8df0 [contrail-config-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 01/20/2025 02:11:03.324 7f2d407e8df0 [contrail-config-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 01/20/2025 02:11:03.324 7f2d407e8df0 [contrail-config-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 01/20/2025 02:11:03.332 7f2d3ae56648 [contrail-config-nodemgr] [ERROR]: Cannot write http_port 8100 to /tmp/contrail-config-nodemgr.0.http_port 01/20/2025 02:11:03.332 7f2d3ae56648 [contrail-config-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8100 01/20/2025 02:11:03.333 7f2d3ae56e48 [contrail-config-nodemgr] [INFO]: Processing event[EvStart] in state[none] 01/20/2025 02:11:03.333 7f2d3ae56e48 [contrail-config-nodemgr] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 01/20/2025 02:11:03.334 7f2d3ae56e48 [contrail-config-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 02:11:03.334 7f2d3ae56e48 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 01/20/2025 02:11:03.334 7f2d3ae56e48 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:03.334 7f2d3ae56e48 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 02:11:03.334 7f2d3ae56e48 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:03.335 7f2d3ae56e48 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:03.335 7f2d3ae56e48 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 01/20/2025 02:11:03.335 7f2d3ae56e48 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:03.479 7f2d407e8df0 [contrail-config-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-api', 'group': 'contrail-api', 'pid': 1148766648276489198938960672437440932327776806281098644580915242112766290230, 'start': '1737339061000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-schema', 'group': 'contrail-schema', 'pid': 6603455365556747157460835229667560447154056443790763248577487270819978543714, 'start': '1737339061000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-svc-monitor', 'group': 'contrail-svc-monitor', 'pid': 1298142584266665311650042655980013964509959714820633487347328381957816307375, 'start': '1737339061000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-device-manager', 'group': 'contrail-device-manager', 'pid': 70320362409372673059966500800362601328198231855851904464905844043137450083493, 'start': '1737339062000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-config-nodemgr', 'group': 'contrail-config-nodemgr', 'pid': 2813258830359568128713024320220555729626853779072882292495434323336827698627, 'start': '1737339061000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 01/20/2025 02:11:03.621 7f2d407e8df0 [contrail-config-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2651-1.', _node_type='Config', _instance_id='0', _timestamp=1737339063621331, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2651-1.', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-config-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 01/20/2025 02:11:03.622 7f2d407e8df0 [contrail-config-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2651-1.', _node_type='Config', _instance_id='0', _timestamp=1737339063621947, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2651-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737339061000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-schema', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737339061000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-svc-monitor', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737339061000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-device-manager', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737339062000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737339061000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-20 01:13:32.439761", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7552-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 01/20/2025 02:11:03.624 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:03.625 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-20 01:13:32.439761", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7552-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 8 num_core_per_socket = 8 num_thread_per_core = 1 >> running_package_version = nightly.r24.1.centos-nightly_r24.1_centos.el7 installed_package_version = nightly.r24.1.centos-nightly_r24.1_centos.el7 >> 01/20/2025 02:11:03.625 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:03.625 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:03.625 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 02:11:03.626 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:03.626 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:03.626 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. deleted = False process_info = [ << process_name = contrail-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737339061000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-schema process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737339061000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-svc-monitor process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737339061000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-device-manager process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737339062000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737339061000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-20 01:13:32.439761", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7552-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} >> 01/20/2025 02:11:03.626 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:07.334 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:11:07.335 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:11:07.336 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:11:07.336 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:11:07.336 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:11:07.336 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:11:07.336 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:11:07.336 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:11:07.337 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:07.337 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:11:07.337 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:07.337 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:07.337 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:11:07.337 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:11.336 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:11:11.337 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:11:11.337 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:11:11.337 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:11:11.337 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:11:11.337 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:11:11.338 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:11:11.338 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:11:11.338 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:11.339 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:11:11.339 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:11.340 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:11.340 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:11:11.340 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:12.664 7f2d407e8df0 [contrail-config-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2651-1.', _node_type='Config', _instance_id='0', _timestamp=1737339072664266, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2651-1.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737339061000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-schema', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737339061000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-svc-monitor', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737339061000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-device-manager', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737339062000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737339061000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-20 01:13:32.439761", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7552-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 01/20/2025 02:11:12.664 7f2d407e8df0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2651-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15468424, partition_space_available_1k=65622060, percentage_partition_space_used=19, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1604, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1572, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=63492, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=164024, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50924, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=5887588, free=10530140, buffers=645348, cached=15602044, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.35, five_min_avg=2.13, fifteen_min_avg=1.37, cpu_share=0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/20/2025 02:11:12.665 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:12.665 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. deleted = False process_info = [ << process_name = contrail-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737339061000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-schema process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737339061000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-svc-monitor process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737339061000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-device-manager process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737339062000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737339061000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-20 01:13:32.439761", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7552-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} >> 01/20/2025 02:11:12.665 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:12.665 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:12.665 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 15468424 partition_space_available_1k = 65622060 percentage_partition_space_used = 19 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-api : << mem_virt = 1604 cpu_share = 0 mem_res = 0 >>contrail-schema : << mem_virt = 1572 cpu_share = 0 mem_res = 0 >>contrail-svc-monitor : << mem_virt = 63492 cpu_share = 0 mem_res = 0 >>contrail-device-manager : << mem_virt = 164024 cpu_share = 0 mem_res = 0 >>contrail-config-nodemgr : << mem_virt = 50924 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 32665120 used = 5887588 free = 10530140 buffers = 645348 cached = 15602044 node_type = config-node >> system_cpu_usage = << one_min_avg = 3.35 five_min_avg = 2.13 fifteen_min_avg = 1.37 cpu_share = 0 node_type = config-node >> >> 01/20/2025 02:11:12.665 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:15.339 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:11:15.341 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:11:15.341 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:11:15.341 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:11:15.341 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:11:15.341 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:11:15.342 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:11:15.342 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:11:15.342 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:15.342 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:11:15.343 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:15.343 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:15.343 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:11:15.343 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:19.341 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:11:19.342 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:11:19.342 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:11:19.342 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:11:19.342 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:11:19.343 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:11:19.343 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:11:19.343 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:11:19.343 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:19.343 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:11:19.343 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:19.343 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:19.343 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:11:19.343 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:23.343 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:11:23.344 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:11:23.344 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:11:23.344 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:11:23.344 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:11:23.344 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:11:23.344 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:11:23.345 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:11:23.345 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:23.345 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:11:23.345 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:23.345 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:23.345 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:11:23.345 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:27.347 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:11:27.348 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:11:27.349 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:11:27.349 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:11:27.349 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:11:27.349 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:11:27.349 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:11:27.349 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:11:27.349 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:27.350 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:11:27.350 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:27.350 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:27.350 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:11:27.350 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:31.352 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:11:31.354 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:11:31.354 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:11:31.354 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:11:31.354 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:11:31.354 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:11:31.354 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:11:31.355 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:11:31.355 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:31.355 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:11:31.355 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:31.355 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:31.355 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:11:31.356 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:35.355 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:11:35.356 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:11:35.356 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:11:35.356 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:11:35.356 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:11:35.356 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:11:35.356 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:11:35.357 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:11:35.357 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:35.357 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:11:35.357 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:35.357 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:35.357 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:11:35.357 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:39.359 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:11:39.360 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:11:39.360 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:11:39.360 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:11:39.361 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:11:39.361 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:11:39.361 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:11:39.361 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:11:39.361 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:39.361 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:11:39.362 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:39.362 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:39.362 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:11:39.362 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:43.361 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:11:43.362 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:11:43.362 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:11:43.362 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:11:43.363 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:11:43.363 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:11:43.363 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:11:43.363 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:11:43.363 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:43.363 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:11:43.363 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:43.363 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:43.363 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:11:43.363 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:47.364 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:11:47.365 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:11:47.365 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:11:47.365 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:11:47.366 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:11:47.366 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:11:47.366 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:11:47.366 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:11:47.366 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:47.366 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:11:47.366 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:47.366 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:47.366 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:11:47.366 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:51.367 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:11:51.368 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:11:51.368 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:11:51.368 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:11:51.368 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:11:51.368 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:11:51.368 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:11:51.368 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:11:51.369 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:51.369 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:11:51.369 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:51.369 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:51.369 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:11:51.369 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:55.369 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:11:55.370 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:11:55.370 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:11:55.370 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:11:55.370 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:11:55.370 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:11:55.370 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:11:55.371 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:11:55.371 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:55.371 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:11:55.371 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:55.371 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:55.371 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:11:55.371 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:59.372 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:11:59.373 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:11:59.373 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:11:59.373 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:11:59.373 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:11:59.373 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:11:59.373 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:11:59.374 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:11:59.374 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:59.374 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:11:59.374 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:59.374 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:11:59.374 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:11:59.374 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:03.376 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:12:03.377 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:12:03.377 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:12:03.377 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:03.377 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:12:03.377 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:03.377 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:12:03.378 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:12:03.378 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:03.378 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:12:03.378 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:03.378 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:03.378 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:12:03.378 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:07.378 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:12:07.379 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:12:07.380 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:12:07.380 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:07.380 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:12:07.380 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:07.380 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:12:07.380 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:12:07.381 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:07.381 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:12:07.381 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:07.381 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:07.381 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:12:07.381 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:11.380 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:12:11.381 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:12:11.381 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:12:11.381 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:11.381 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:12:11.381 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:11.381 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:12:11.382 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:12:11.382 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:11.382 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:12:11.382 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:11.382 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:11.382 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:12:11.382 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:12.658 7f2d407e8df0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2651-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=15764976, partition_space_available_1k=65325508, percentage_partition_space_used=19, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=102760, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=71132, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=80728, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=173140, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51168, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=6212400, free=10069804, buffers=647028, cached=15735888, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.04, five_min_avg=2.25, fifteen_min_avg=1.46, cpu_share=3.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/20/2025 02:12:12.658 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:12.658 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 15764976 partition_space_available_1k = 65325508 percentage_partition_space_used = 19 >> } process_mem_cpu_usage = { contrail-api : << mem_virt = 102760 cpu_share = 0 mem_res = 0 >>contrail-schema : << mem_virt = 71132 cpu_share = 0 mem_res = 0 >>contrail-svc-monitor : << mem_virt = 80728 cpu_share = 0 mem_res = 0 >>contrail-device-manager : << mem_virt = 173140 cpu_share = 0 mem_res = 0 >>contrail-config-nodemgr : << mem_virt = 51168 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 32665120 used = 6212400 free = 10069804 buffers = 647028 cached = 15735888 node_type = config-node >> system_cpu_usage = << one_min_avg = 3.04 five_min_avg = 2.25 fifteen_min_avg = 1.46 cpu_share = 3.5 node_type = config-node >> >> 01/20/2025 02:12:12.658 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:15.383 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:12:15.384 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:12:15.385 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:12:15.385 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:15.385 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:12:15.385 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:15.385 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:12:15.385 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:12:15.385 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:15.386 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:12:15.386 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:15.386 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:15.386 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:12:15.386 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:19.388 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:12:19.389 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:12:19.389 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:12:19.389 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:19.389 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:12:19.389 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:19.389 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:12:19.390 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:12:19.390 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:19.390 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:12:19.390 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:19.390 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:19.390 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:12:19.390 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:23.392 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:12:23.393 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:12:23.394 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:12:23.394 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:23.394 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:12:23.394 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:23.394 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:12:23.394 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:12:23.395 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:23.395 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:12:23.395 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:23.395 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:23.395 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:12:23.395 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:27.397 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:12:27.399 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:12:27.399 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:12:27.399 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:27.399 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:12:27.399 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:27.399 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:12:27.400 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:12:27.400 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:27.400 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:12:27.400 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:27.400 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:27.400 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:12:27.400 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:31.402 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:12:31.404 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:12:31.404 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:12:31.404 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:31.404 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:12:31.404 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:31.404 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:12:31.405 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:12:31.405 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:31.405 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:12:31.405 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:31.405 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:31.405 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:12:31.405 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:35.404 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:12:35.405 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:12:35.405 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:12:35.405 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:35.405 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:12:35.405 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:35.405 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:12:35.406 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:12:35.406 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:35.406 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:12:35.406 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:35.406 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:35.406 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:12:35.406 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:39.408 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:12:39.409 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:12:39.409 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:12:39.409 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:39.409 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:12:39.409 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:39.409 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:12:39.410 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:12:39.410 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:39.410 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:12:39.410 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:39.410 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:39.410 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:12:39.410 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:43.413 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:12:43.414 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:12:43.414 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:12:43.414 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:43.414 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:12:43.414 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:43.414 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:12:43.415 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:12:43.415 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:43.415 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:12:43.415 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:43.415 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:43.415 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:12:43.415 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:47.416 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:12:47.417 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:12:47.417 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:12:47.417 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:47.417 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:12:47.417 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:47.417 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:12:47.418 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:12:47.418 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:47.418 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:12:47.418 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:47.418 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:47.418 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:12:47.418 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:51.418 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:12:51.419 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:12:51.419 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:12:51.419 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:51.419 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:12:51.419 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:51.419 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:12:51.420 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:12:51.420 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:51.420 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:12:51.420 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:51.420 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:51.420 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:12:51.420 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:55.420 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:12:55.421 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:12:55.421 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:12:55.421 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:55.421 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:12:55.421 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:55.421 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:12:55.422 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:12:55.422 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:55.422 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:12:55.422 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:55.422 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:55.422 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:12:55.422 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:59.421 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:12:59.423 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:12:59.423 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:12:59.423 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:59.423 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:12:59.423 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:12:59.423 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:12:59.423 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:12:59.424 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:59.424 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:12:59.424 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:59.424 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:12:59.424 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:12:59.424 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:03.424 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:13:03.426 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:13:03.426 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:13:03.426 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:03.426 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:13:03.426 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:03.426 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:13:03.427 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:13:03.427 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:03.427 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:13:03.427 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:03.427 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:03.427 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:13:03.427 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:07.427 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:13:07.428 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:13:07.428 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:13:07.429 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:07.429 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:13:07.429 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:07.429 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:13:07.429 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:13:07.429 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:07.429 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:13:07.429 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:07.429 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:07.430 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:13:07.430 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:11.430 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:13:11.431 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:13:11.431 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:13:11.431 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:11.431 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:13:11.431 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:11.431 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:13:11.432 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:13:11.432 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:11.432 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:13:11.432 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:11.432 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:11.432 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:13:11.432 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:13.456 7f2d407e8df0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2651-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=16187024, partition_space_available_1k=64903460, percentage_partition_space_used=20, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=103564, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=71300, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=80832, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=173888, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51372, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=6405316, free=9412388, buffers=672640, cached=16174776, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.65, five_min_avg=2.26, fifteen_min_avg=1.51, cpu_share=2.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/20/2025 02:13:13.457 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:13.457 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 16187024 partition_space_available_1k = 64903460 percentage_partition_space_used = 20 >> } process_mem_cpu_usage = { contrail-api : << mem_virt = 103564 cpu_share = 0 mem_res = 0 >>contrail-schema : << mem_virt = 71300 cpu_share = 0 mem_res = 0 >>contrail-svc-monitor : << mem_virt = 80832 cpu_share = 0 mem_res = 0 >>contrail-device-manager : << mem_virt = 173888 cpu_share = 0 mem_res = 0 >>contrail-config-nodemgr : << mem_virt = 51372 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 32665120 used = 6405316 free = 9412388 buffers = 672640 cached = 16174776 node_type = config-node >> system_cpu_usage = << one_min_avg = 2.65 five_min_avg = 2.26 fifteen_min_avg = 1.51 cpu_share = 2.5 node_type = config-node >> >> 01/20/2025 02:13:13.457 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:15.432 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:13:15.434 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:13:15.434 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:13:15.434 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:15.434 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:13:15.434 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:15.434 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:13:15.434 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:13:15.434 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:15.434 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:13:15.435 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:15.435 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:15.435 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:13:15.435 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:19.436 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:13:19.437 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:13:19.437 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:13:19.437 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:19.437 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:13:19.437 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:19.437 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:13:19.438 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:13:19.438 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:19.438 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:13:19.438 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:19.438 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:19.438 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:13:19.438 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:23.439 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:13:23.441 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:13:23.441 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:13:23.441 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:23.441 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:13:23.441 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:23.441 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:13:23.442 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:13:23.442 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:23.442 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:13:23.442 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:23.442 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:23.442 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:13:23.442 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:27.444 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:13:27.446 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:13:27.446 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:13:27.446 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:27.447 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:13:27.447 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:27.447 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:13:27.447 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:13:27.447 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:27.447 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:13:27.447 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:27.448 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:27.448 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:13:27.448 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:31.449 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:13:31.450 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:13:31.451 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:13:31.451 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:31.451 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:13:31.451 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:31.451 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:13:31.451 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:13:31.452 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:31.452 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:13:31.452 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:31.452 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:31.452 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:13:31.452 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:35.451 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:13:35.453 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:13:35.453 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:13:35.453 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:35.454 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:13:35.454 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:35.454 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:13:35.454 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:13:35.454 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:35.455 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:13:35.455 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:35.455 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:35.455 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:13:35.455 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:39.456 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:13:39.457 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:13:39.457 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:13:39.457 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:39.457 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:13:39.457 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:39.457 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:13:39.458 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:13:39.458 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:39.458 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:13:39.458 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:39.458 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:39.458 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:13:39.458 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:43.461 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:13:43.462 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:13:43.462 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:13:43.462 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:43.462 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:13:43.462 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:43.462 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:13:43.463 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:13:43.463 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:43.463 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:13:43.463 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:43.463 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:43.463 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:13:43.463 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:47.464 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:13:47.465 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:13:47.465 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:13:47.465 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:47.465 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:13:47.465 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:47.465 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:13:47.466 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:13:47.466 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:47.466 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:13:47.466 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:47.466 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:47.466 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:13:47.466 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:51.466 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:13:51.467 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:13:51.467 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:13:51.467 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:51.467 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:13:51.467 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:51.467 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:13:51.468 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:13:51.468 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:51.468 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:13:51.468 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:51.468 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:51.468 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:13:51.468 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:55.467 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:13:55.468 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:13:55.469 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:13:55.469 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:55.469 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:13:55.469 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:55.469 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:13:55.469 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:13:55.469 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:55.470 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:13:55.470 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:55.470 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:55.470 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:13:55.470 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:59.472 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:13:59.473 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:13:59.473 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:13:59.473 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:59.473 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:13:59.473 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:13:59.473 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:13:59.474 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:13:59.474 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:59.474 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:13:59.474 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:59.474 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:13:59.474 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:13:59.474 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:03.476 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:14:03.477 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:14:03.478 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:14:03.478 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:14:03.478 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:14:03.478 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:14:03.478 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:14:03.478 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:14:03.478 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:03.478 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:14:03.478 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:03.479 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:03.479 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:14:03.479 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:07.478 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:14:07.480 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:14:07.480 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:14:07.481 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:14:07.481 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:14:07.481 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:14:07.481 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:14:07.482 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:14:07.482 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:07.482 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:14:07.482 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:07.482 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:07.482 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:14:07.482 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:11.481 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:14:11.483 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:14:11.483 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:14:11.483 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:14:11.483 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:14:11.483 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:14:11.483 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:14:11.484 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:14:11.484 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:11.484 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:14:11.484 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:11.484 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:11.484 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:14:11.485 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:13.468 7f2d407e8df0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2651-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=16282296, partition_space_available_1k=64808188, percentage_partition_space_used=20, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=103632, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=71356, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=80888, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=173948, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51528, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=7757408, free=8041068, buffers=674912, cached=16191732, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.68, five_min_avg=2.3, fifteen_min_avg=1.57, cpu_share=2.75, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/20/2025 02:14:13.469 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:13.469 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 16282296 partition_space_available_1k = 64808188 percentage_partition_space_used = 20 >> } process_mem_cpu_usage = { contrail-api : << mem_virt = 103632 cpu_share = 0 mem_res = 0 >>contrail-schema : << mem_virt = 71356 cpu_share = 0 mem_res = 0 >>contrail-svc-monitor : << mem_virt = 80888 cpu_share = 0 mem_res = 0 >>contrail-device-manager : << mem_virt = 173948 cpu_share = 0 mem_res = 0 >>contrail-config-nodemgr : << mem_virt = 51528 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 32665120 used = 7757408 free = 8041068 buffers = 674912 cached = 16191732 node_type = config-node >> system_cpu_usage = << one_min_avg = 2.68 five_min_avg = 2.3 fifteen_min_avg = 1.57 cpu_share = 2.75 node_type = config-node >> >> 01/20/2025 02:14:13.469 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:15.484 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:14:15.485 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:14:15.485 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:14:15.485 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:14:15.485 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:14:15.486 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:14:15.486 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:14:15.486 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:14:15.486 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:15.486 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:14:15.486 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:15.486 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:15.486 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:14:15.486 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:19.488 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:14:19.489 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:14:19.489 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:14:19.489 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:14:19.489 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:14:19.489 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:14:19.489 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:14:19.490 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:14:19.490 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:19.490 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:14:19.490 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:19.490 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:19.490 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:14:19.490 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:23.491 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:14:23.493 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:14:23.493 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:14:23.493 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:14:23.493 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:14:23.493 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:14:23.493 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:14:23.494 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:14:23.494 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:23.494 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:14:23.494 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:23.494 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:23.494 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:14:23.495 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:27.497 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:14:27.499 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:14:27.499 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:14:27.499 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:14:27.500 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:14:27.500 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:14:27.500 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:14:27.500 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:14:27.501 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:27.501 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:14:27.501 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:27.501 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:27.501 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:14:27.501 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:31.500 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:14:31.501 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:14:31.501 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:14:31.501 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:14:31.501 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:14:31.502 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:14:31.502 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:14:31.502 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:14:31.502 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:31.502 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:14:31.502 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:31.502 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:31.502 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:14:31.503 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:35.505 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:14:35.506 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:14:35.506 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:14:35.506 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:14:35.507 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:14:35.507 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:14:35.507 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:14:35.507 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:14:35.507 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:35.507 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:14:35.507 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:35.507 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:35.508 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:14:35.508 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:39.506 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:14:39.507 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:14:39.508 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:14:39.508 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:14:39.508 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:14:39.508 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:14:39.508 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:14:39.508 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:14:39.508 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:39.508 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:14:39.508 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:39.508 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:39.509 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:14:39.509 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:43.510 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:14:43.511 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:14:43.512 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:14:43.512 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:14:43.512 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:14:43.512 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:14:43.512 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:14:43.512 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:14:43.512 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:43.512 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:14:43.512 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:43.512 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:43.513 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:14:43.513 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:47.512 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:14:47.513 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 02:14:47.513 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:14:47.513 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:14:47.513 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:14:47.513 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:14:47.514 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 02:14:47.514 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 02:14:47.514 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:47.514 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 02:14:47.514 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:47.514 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:47.514 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1.:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1737339063334323 collector_name = collector_ip = 10.0.0.40:8086 collector_list = [ 10.0.0.40:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 02:14:47.514 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 02:14:51.514 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 02:14:51.515 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Session Event: TCP Connected 01/20/2025 02:14:51.515 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 02:14:51.515 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:14:51.516 7f2d3a0f0348 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2651-1. process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.40:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 02:14:51.516 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 02:14:51.516 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/20/2025 02:14:51.516 7f2d3a0f0348 [contrail-config-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 01/20/2025 02:14:51.516 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/20/2025 02:14:51.517 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 02:14:51.517 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 02:14:57.421 7f2d3af6a348 [contrail-config-nodemgr] [DEBUG]: Extracted sandesh length: 0000001016 01/20/2025 02:14:57.422 7f2d3af6a348 [contrail-config-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/20/2025 02:14:57.423 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 01/20/2025 02:14:57.423 7f2d3a0f0348 [contrail-config-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 01/20/2025 02:14:57.424 7f2d3a0f0348 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/20/2025 02:14:57.424 7f2d3a0f0348 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 02:14:57.424 7f2d3a0f0348 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 01/20/2025 02:14:57.425 7f2d3a0f0048 [contrail-config-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/20/2025 02:14:57.427 7f2d3a0f0048 [contrail-config-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/20/2025 02:15:11.412 7f2d3af6a348 [contrail-config-nodemgr] [DEBUG]: Extracted sandesh length: 0000001297 01/20/2025 02:15:11.413 7f2d3af6a348 [contrail-config-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/20/2025 02:15:11.414 7f2d3a0f0048 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 01/20/2025 02:15:11.414 7f2d3a0f0048 [contrail-config-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 01/20/2025 02:15:11.414 7f2d3a0f0048 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/20/2025 02:15:11.415 7f2d3a0f0048 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 02:15:13.480 7f2d407e8df0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2651-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=16592916, partition_space_available_1k=64497568, percentage_partition_space_used=20, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=103716, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=71432, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=80900, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=173968, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51820, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=8640468, free=6727340, buffers=684432, cached=16612880, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.06, five_min_avg=2.65, fifteen_min_avg=1.73, cpu_share=3.38, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/20/2025 02:16:13.486 7f2d407e8df0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2651-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=17617684, partition_space_available_1k=63472800, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=98328, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69640, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=78812, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=165016, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44008, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=8941624, free=20366308, buffers=709356, cached=2647832, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.9, five_min_avg=2.87, fifteen_min_avg=1.86, cpu_share=4.62, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/20/2025 02:17:11.172 7f2d3a0f0348 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/20/2025 02:17:13.419 7f2d3a0f0348 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/20/2025 02:17:13.506 7f2d407e8df0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2651-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=17693744, partition_space_available_1k=63396740, percentage_partition_space_used=22, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=98472, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69716, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=78816, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=165024, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44044, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9612000, free=19096492, buffers=718172, cached=3238456, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.94, five_min_avg=2.77, fifteen_min_avg=1.9, cpu_share=4.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/20/2025 02:18:13.512 7f2d407e8df0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2651-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19480888, partition_space_available_1k=61609596, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=98480, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=69748, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=78828, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=165024, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44144, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=9765836, free=17406604, buffers=756372, cached=4736308, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.3, five_min_avg=2.88, fifteen_min_avg=1.99, cpu_share=3.62, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/20/2025 02:18:28.281 7f2d3a0f0348 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/20/2025 02:19:13.511 7f2d407e8df0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2651-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19525452, partition_space_available_1k=61565032, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=102724, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=70180, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=79000, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=165192, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44152, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=10579748, free=16510156, buffers=756528, cached=4818688, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.31, five_min_avg=3.2, fifteen_min_avg=2.16, cpu_share=4.75, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/20/2025 02:20:13.527 7f2d407e8df0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2651-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19554924, partition_space_available_1k=61535560, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=105448, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=70984, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=79400, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=165764, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44172, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=10273320, free=16770484, buffers=757232, cached=4864084, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.44, five_min_avg=3.16, fifteen_min_avg=2.21, cpu_share=5.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/20/2025 02:21:13.538 7f2d407e8df0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2651-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19624180, partition_space_available_1k=61466304, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=110012, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=71736, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=79920, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=166348, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44188, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=11063228, free=15929200, buffers=757360, cached=4915332, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.22, five_min_avg=3.62, fifteen_min_avg=2.42, cpu_share=5.62, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/20/2025 02:22:13.536 7f2d407e8df0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2651-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19662800, partition_space_available_1k=61427684, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=111148, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=72220, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=80152, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=166624, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44212, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=10406828, free=16560244, buffers=757532, cached=4940516, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.2, five_min_avg=3.59, fifteen_min_avg=2.48, cpu_share=4.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/20/2025 02:23:13.551 7f2d407e8df0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2651-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19654060, partition_space_available_1k=61436424, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=112608, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=72468, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=80332, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=166800, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44192, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=10547516, free=16399196, buffers=757688, cached=4960720, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.22, five_min_avg=3.64, fifteen_min_avg=2.57, cpu_share=3.88, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/20/2025 02:24:13.549 7f2d407e8df0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2651-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19676996, partition_space_available_1k=61413488, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=115580, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=72784, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=80524, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=167028, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44192, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=11318048, free=15600296, buffers=757732, cached=4989044, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.41, five_min_avg=4.03, fifteen_min_avg=2.76, cpu_share=5.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/20/2025 02:24:52.578 7f2d3a0f0348 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/20/2025 02:25:13.538 7f2d407e8df0 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2651-1.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=19772600, partition_space_available_1k=61317884, percentage_partition_space_used=24, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=115868, cpu_share=0, mem_res=0, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=72908, cpu_share=0, mem_res=0, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=80628, cpu_share=0, mem_res=0, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=167144, cpu_share=0, mem_res=0, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44196, cpu_share=0, mem_res=0, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665120, used=10390932, free=16370660, buffers=760196, cached=5143332, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.1, five_min_avg=3.88, fifteen_min_avg=2.79, cpu_share=4.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/20/2025 02:25:31.786 7f2d3a0f0048 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map