01/20/2025 00:50:00.689 7ffbf266fdf0 [contrail-control-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 01/20/2025 00:50:00.689 7ffbf266fdf0 [contrail-control-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 01/20/2025 00:50:00.689 7ffbf266fdf0 [contrail-control-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 01/20/2025 00:50:00.696 7ffbecca6648 [contrail-control-nodemgr] [ERROR]: Cannot write http_port 8101 to /tmp/contrail-control-nodemgr.0.http_port 01/20/2025 00:50:00.697 7ffbecca6648 [contrail-control-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8101 01/20/2025 00:50:00.698 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvStart] in state[none] 01/20/2025 00:50:00.699 7ffbecca6e48 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectBgpRouter:NodeStatusUVE] map 01/20/2025 00:50:00.699 7ffbecca6e48 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 00:50:00.700 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 01/20/2025 00:50:00.700 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:00.701 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 00:50:00.701 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:00.701 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:00.701 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 01/20/2025 00:50:00.701 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:00.803 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-control', 'group': 'contrail-control', 'pid': 19140985496145716636187149272654245922758771848541344294350853972611144174966, 'start': '1737334198000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-dns', 'group': 'contrail-dns', 'pid': 114084692060356175520662642385921189929214827733546583976269148258353650333251, 'start': '1737334198000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-named', 'group': 'contrail-named', 'pid': 81877986201981186395552062726239170719310797874084898725203248385806006037053, 'start': '1737334199000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-control-nodemgr', 'group': 'contrail-control-nodemgr', 'pid': 90576548377340355038481826125717213888150492487734243117501024228744003738557, 'start': '1737334198000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 01/20/2025 00:50:00.943 7ffbf266fdf0 [contrail-control-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2650-3', _node_type='Control', _instance_id='0', _timestamp=1737334200942954, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-control-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 01/20/2025 00:50:00.943 7ffbf266fdf0 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2650-3', _node_type='Control', _instance_id='0', _timestamp=1737334200943513, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737334198000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737334198000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737334199000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737334198000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-16 01:14:15.868302", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7545-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 01/20/2025 00:50:00.946 7ffbece69148 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:00.947 7ffbece69148 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-16 01:14:15.868302", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7545-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 4 num_core_per_socket = 4 num_thread_per_core = 1 >> running_package_version = nightly.r24.1.centos-nightly_r24.1_centos.el7 installed_package_version = nightly.r24.1.centos-nightly_r24.1_centos.el7 >> 01/20/2025 00:50:00.947 7ffbece69148 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:00.947 7ffbece69148 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:00.947 7ffbece69148 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 00:50:00.947 7ffbece69148 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:00.947 7ffbece69148 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:00.947 7ffbece69148 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 deleted = False process_info = [ << process_name = contrail-control process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737334198000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-dns process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737334198000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-named process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737334199000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-control-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737334198000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-16 01:14:15.868302", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7545-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} >> 01/20/2025 00:50:00.947 7ffbece69148 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:04.699 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:04.701 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:04.701 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:04.701 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:04.701 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:04.701 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:04.701 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:04.702 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:04.702 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:04.702 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:04.702 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:04.702 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:04.702 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:50:04.702 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:07.980 7ffbf266fdf0 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2650-3', _node_type='Control', _instance_id='0', _timestamp=1737334207980257, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737334198000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737334198000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737334199000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737334198000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-16 01:14:15.868302", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7545-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 01/20/2025 00:50:07.980 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6364216, partition_space_available_1k=74726268, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18732, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17924, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50704, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=3024404, free=6828324, buffers=216028, cached=6106884, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.2, five_min_avg=1.09, fifteen_min_avg=0.5, cpu_share=0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 00:50:07.980 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:07.981 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 deleted = False process_info = [ << process_name = contrail-control process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737334198000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-dns process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737334198000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-named process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737334199000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-control-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737334198000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-16 01:14:15.868302", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7545-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} >> 01/20/2025 00:50:07.981 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:07.981 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:07.981 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 6364216 partition_space_available_1k = 74726268 percentage_partition_space_used = 8 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-control : << mem_virt = 18732 cpu_share = 0 mem_res = 0 >>contrail-dns : << mem_virt = 17924 cpu_share = 0 mem_res = 0 >>contrail-named : << mem_virt = 24000 cpu_share = 0 mem_res = 0 >>contrail-control-nodemgr : << mem_virt = 50704 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 16175640 used = 3024404 free = 6828324 buffers = 216028 cached = 6106884 node_type = control-node >> system_cpu_usage = << one_min_avg = 1.2 five_min_avg = 1.09 fifteen_min_avg = 0.5 cpu_share = 0 node_type = control-node >> >> 01/20/2025 00:50:07.981 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:08.702 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:08.703 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:08.703 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:08.704 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:08.704 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:08.704 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:08.704 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:08.704 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:08.705 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:08.705 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:08.705 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:08.705 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:08.705 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:50:08.705 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:12.705 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:12.706 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:12.707 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:12.707 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:12.707 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:12.707 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:12.707 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:12.707 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:12.707 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:12.707 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:12.708 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:12.708 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:12.708 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:50:12.708 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:16.707 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:16.708 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:16.708 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:16.708 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:16.708 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:16.709 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:16.709 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:16.709 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:16.709 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:16.709 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:16.709 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:16.709 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:16.709 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:50:16.709 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:20.709 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:20.710 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:20.710 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:20.710 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:20.711 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:20.711 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:20.711 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:20.711 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:20.711 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:20.711 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:20.712 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:20.712 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:20.712 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:50:20.712 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:24.714 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:24.716 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:24.716 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:24.716 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:24.717 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:24.717 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:24.717 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:24.717 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:24.717 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:24.717 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:24.718 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:24.718 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:24.718 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:50:24.718 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:28.719 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:28.720 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:28.720 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:28.721 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:28.721 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:28.721 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:28.721 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:28.721 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:28.721 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:28.721 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:28.721 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:28.721 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:28.722 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:50:28.722 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:32.722 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:32.723 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:32.723 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:32.723 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:32.723 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:32.723 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:32.723 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:32.724 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:32.724 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:32.724 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:32.724 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:32.724 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:32.724 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:50:32.724 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:36.727 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:36.728 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:36.728 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:36.728 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:36.728 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:36.729 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:36.729 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:36.729 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:36.729 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:36.729 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:36.729 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:36.729 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:36.729 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:50:36.729 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:40.732 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:40.733 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:40.734 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:40.734 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:40.734 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:40.734 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:40.734 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:40.734 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:40.734 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:40.734 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:40.734 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:40.734 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:40.735 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:50:40.735 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:44.737 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:44.738 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:44.738 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:44.739 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:44.739 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:44.739 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:44.739 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:44.739 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:44.740 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:44.740 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:44.740 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:44.740 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:44.740 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:50:44.740 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:48.740 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:48.742 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:48.742 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:48.742 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:48.742 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:48.743 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:48.743 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:48.743 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:48.743 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:48.743 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:48.743 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:48.743 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:48.743 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:50:48.743 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:52.745 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:52.746 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:52.746 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:52.746 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:52.747 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:52.747 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:52.747 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:52.747 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:52.747 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:52.747 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:52.747 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:52.747 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:52.747 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:50:52.747 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:56.747 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:56.749 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:56.749 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:56.749 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:56.749 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:56.749 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:56.749 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:56.750 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:56.750 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:56.750 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:56.750 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:56.750 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:56.751 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:50:56.751 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:00.751 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:00.753 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:00.753 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:00.753 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:00.753 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:00.753 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:00.753 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:00.754 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:00.754 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:00.754 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:00.754 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:00.754 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:00.754 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:51:00.754 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:04.754 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:04.756 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:04.756 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:04.756 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:04.756 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:04.756 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:04.756 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:04.757 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:04.757 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:04.757 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:04.757 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:04.757 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:04.757 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:51:04.757 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:07.971 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6744324, partition_space_available_1k=74346160, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20100, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18644, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50872, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=4350176, free=5307196, buffers=238312, cached=6279956, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.16, five_min_avg=1.07, fifteen_min_avg=0.53, cpu_share=4.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 00:51:07.972 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:07.972 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 6744324 partition_space_available_1k = 74346160 percentage_partition_space_used = 8 >> } process_mem_cpu_usage = { contrail-control : << mem_virt = 20100 cpu_share = 0 mem_res = 0 >>contrail-dns : << mem_virt = 18644 cpu_share = 0 mem_res = 0 >>contrail-named : << mem_virt = 24000 cpu_share = 0 mem_res = 0 >>contrail-control-nodemgr : << mem_virt = 50872 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 16175640 used = 4350176 free = 5307196 buffers = 238312 cached = 6279956 node_type = control-node >> system_cpu_usage = << one_min_avg = 1.16 five_min_avg = 1.07 fifteen_min_avg = 0.53 cpu_share = 4.25 node_type = control-node >> >> 01/20/2025 00:51:07.972 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:08.756 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:08.757 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:08.758 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:08.758 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:08.758 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:08.758 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:08.758 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:08.758 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:08.758 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:08.758 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:08.758 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:08.758 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:08.759 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:51:08.759 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:12.760 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:12.762 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:12.762 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:12.762 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:12.763 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:12.763 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:12.763 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:12.763 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:12.763 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:12.763 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:12.764 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:12.764 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:12.764 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:51:12.764 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:16.763 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:16.765 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:16.765 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:16.765 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:16.765 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:16.765 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:16.765 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:16.766 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:16.766 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:16.766 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:16.766 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:16.766 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:16.766 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:51:16.766 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:20.765 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:20.766 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:20.766 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:20.766 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:20.766 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:20.766 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:20.766 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:20.767 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:20.767 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:20.767 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:20.767 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:20.767 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:20.767 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:51:20.767 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:24.767 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:24.768 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:24.769 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:24.769 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:24.769 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:24.769 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:24.769 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:24.769 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:24.769 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:24.769 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:24.769 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:24.770 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:24.770 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:51:24.770 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:28.772 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:28.774 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:28.774 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:28.774 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:28.774 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:28.774 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:28.774 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:28.774 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:28.775 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:28.775 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:28.775 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:28.775 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:28.775 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:51:28.775 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:32.775 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:32.776 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:32.776 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:32.776 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:32.776 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:32.776 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:32.777 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:32.777 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:32.777 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:32.777 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:32.777 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:32.777 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:32.777 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:51:32.777 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:36.780 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:36.781 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:36.781 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:36.781 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:36.782 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:36.782 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:36.782 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:36.782 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:36.782 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:36.782 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:36.782 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:36.782 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:36.783 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:51:36.783 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:40.785 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:40.787 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:40.787 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:40.787 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:40.787 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:40.787 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:40.787 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:40.787 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:40.787 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:40.787 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:40.788 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:40.788 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:40.788 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:51:40.788 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:44.789 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:44.790 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:44.790 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:44.790 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:44.790 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:44.790 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:44.790 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:44.791 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:44.791 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:44.791 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:44.791 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:44.791 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:44.791 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:51:44.791 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:48.792 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:48.793 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:48.793 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:48.794 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:48.794 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:48.794 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:48.794 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:48.794 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:48.794 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:48.794 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:48.794 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:48.794 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:48.795 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:51:48.795 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:52.797 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:52.798 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:52.799 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:52.799 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:52.799 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:52.799 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:52.799 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:52.800 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:52.800 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:52.800 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:52.800 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:52.800 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:52.800 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:51:52.800 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:56.801 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:56.802 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:56.802 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:56.803 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:56.803 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:56.803 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:56.803 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:56.803 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:56.804 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:56.804 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:56.804 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:56.804 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:56.804 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:51:56.804 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:52:00.805 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:52:00.807 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:52:00.807 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:52:00.807 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:52:00.807 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:52:00.807 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:52:00.807 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:52:00.808 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:52:00.808 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:52:00.808 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:52:00.808 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:52:00.808 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:52:00.808 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737334200699803 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 00:52:00.809 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:52:04.807 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:52:04.809 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 01/20/2025 00:52:04.809 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:52:04.809 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:52:04.809 7ffbecca6e48 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:52:04.809 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:52:04.809 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/20/2025 00:52:04.809 7ffbecca6e48 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 01/20/2025 00:52:04.810 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/20/2025 00:52:04.810 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 00:52:04.810 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 00:52:08.006 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6759724, partition_space_available_1k=74330760, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20448, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18992, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51212, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=4561140, free=5070956, buffers=243544, cached=6300000, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.14, five_min_avg=1.06, fifteen_min_avg=0.56, cpu_share=4.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 00:52:08.006 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 00:52:16.690 7ffbece69148 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001016 01/20/2025 00:52:16.691 7ffbece69148 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/20/2025 00:52:16.692 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 01/20/2025 00:52:16.692 7ffbecca6e48 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 01/20/2025 00:52:16.692 7ffbecca6e48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 01/20/2025 00:52:16.692 7ffbecca6e48 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 00:52:16.692 7ffbecca6e48 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 01/20/2025 00:52:16.693 7ffbebf76048 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/20/2025 00:52:16.694 7ffbebf76048 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/20/2025 00:52:28.528 7ffbece69148 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001296 01/20/2025 00:52:28.529 7ffbece69148 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/20/2025 00:52:28.529 7ffbebf76048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 01/20/2025 00:52:28.530 7ffbebf76048 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 01/20/2025 00:52:28.530 7ffbebf76048 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 01/20/2025 00:52:28.530 7ffbebf76048 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 00:53:07.993 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7187992, partition_space_available_1k=73902492, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20640, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19168, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51496, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5498056, free=3646744, buffers=261552, cached=6769288, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.94, five_min_avg=1.6, fifteen_min_avg=0.78, cpu_share=11.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 00:54:08.006 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7251428, partition_space_available_1k=73839056, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20720, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19304, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51508, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5519008, free=3563164, buffers=262920, cached=6830548, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.08, five_min_avg=1.85, fifteen_min_avg=0.92, cpu_share=12.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 00:55:08.043 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7277548, partition_space_available_1k=73812936, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20780, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19312, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51536, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5600924, free=3452612, buffers=264916, cached=6857188, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.45, five_min_avg=2.15, fifteen_min_avg=1.08, cpu_share=13.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 00:56:08.034 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7292900, partition_space_available_1k=73797584, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21292, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19328, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51568, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5674832, free=3354208, buffers=266900, cached=6879700, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.72, five_min_avg=2.43, fifteen_min_avg=1.24, cpu_share=14.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 00:56:32.973 7ffbebf76048 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 01/20/2025 00:56:52.981 7ffbebf76048 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 01/20/2025 00:57:08.041 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7753228, partition_space_available_1k=73337256, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21532, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19332, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51624, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5757064, free=2800652, buffers=273496, cached=7344428, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.3, five_min_avg=2.83, fifteen_min_avg=1.46, cpu_share=14.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 00:58:08.047 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7747416, partition_space_available_1k=73343068, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21748, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19384, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51676, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5824240, free=2728736, buffers=274732, cached=7347932, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.99, five_min_avg=3.02, fifteen_min_avg=1.61, cpu_share=13.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 00:59:08.063 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7764764, partition_space_available_1k=73325720, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21872, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19448, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51684, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5863568, free=2675024, buffers=275548, cached=7361500, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.0, five_min_avg=3.47, fifteen_min_avg=1.85, cpu_share=13.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:00:08.084 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7775340, partition_space_available_1k=73315144, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21960, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19476, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51724, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5927160, free=2604216, buffers=276184, cached=7368080, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.83, five_min_avg=3.43, fifteen_min_avg=1.94, cpu_share=13.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:01:08.073 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7778852, partition_space_available_1k=73311632, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21856, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19504, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51728, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5992036, free=2525100, buffers=276592, cached=7381912, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.95, five_min_avg=3.54, fifteen_min_avg=2.08, cpu_share=13.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:02:08.074 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7788752, partition_space_available_1k=73301732, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22016, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19504, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51748, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5950144, free=2550756, buffers=276944, cached=7397796, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.04, five_min_avg=3.61, fifteen_min_avg=2.19, cpu_share=13.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:03:08.079 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7796168, partition_space_available_1k=73294316, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22232, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19520, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51764, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6011516, free=2481900, buffers=277240, cached=7404984, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.54, five_min_avg=3.52, fifteen_min_avg=2.25, cpu_share=13.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:04:08.088 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7810200, partition_space_available_1k=73280284, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22312, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19524, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51776, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6059240, free=2423612, buffers=277408, cached=7415380, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.45, five_min_avg=3.5, fifteen_min_avg=2.32, cpu_share=13.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:05:08.103 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7820732, partition_space_available_1k=73269752, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22204, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19524, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51780, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6079180, free=2397328, buffers=277592, cached=7421540, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.29, five_min_avg=3.43, fifteen_min_avg=2.37, cpu_share=13.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:06:08.100 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7827052, partition_space_available_1k=73263432, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22132, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19568, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51780, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6164532, free=2299348, buffers=277676, cached=7434084, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.68, five_min_avg=3.78, fifteen_min_avg=2.56, cpu_share=13.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:07:08.096 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7837300, partition_space_available_1k=73253184, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22256, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19568, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51776, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6177604, free=2276144, buffers=277744, cached=7444148, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.15, five_min_avg=3.79, fifteen_min_avg=2.64, cpu_share=13.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:08:08.102 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7853496, partition_space_available_1k=73236988, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22136, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19568, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51784, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6163340, free=2278008, buffers=277792, cached=7456500, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.32, five_min_avg=3.91, fifteen_min_avg=2.75, cpu_share=13.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:09:08.109 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7854184, partition_space_available_1k=73236300, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22208, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19576, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51784, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6183732, free=2247100, buffers=277820, cached=7466988, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.88, five_min_avg=3.86, fifteen_min_avg=2.81, cpu_share=12.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:10:08.115 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7860472, partition_space_available_1k=73230012, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22284, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19576, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51792, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6157000, free=2272448, buffers=277828, cached=7468364, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.04, five_min_avg=3.93, fifteen_min_avg=2.91, cpu_share=13.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:11:08.113 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7870988, partition_space_available_1k=73219496, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22300, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19576, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51800, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6180440, free=2242696, buffers=277836, cached=7474668, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.38, five_min_avg=4.02, fifteen_min_avg=3.0, cpu_share=12.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:12:08.107 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7876500, partition_space_available_1k=73213984, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22296, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19576, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51800, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6185660, free=2227152, buffers=277844, cached=7484984, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.75, five_min_avg=3.88, fifteen_min_avg=3.02, cpu_share=12.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:13:08.127 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7887464, partition_space_available_1k=73203020, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22276, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19576, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51804, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6178708, free=2227884, buffers=277856, cached=7491192, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.34, five_min_avg=4.0, fifteen_min_avg=3.11, cpu_share=13.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:14:08.117 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7892972, partition_space_available_1k=73197512, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22192, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19580, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51800, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6229488, free=2166160, buffers=277876, cached=7502116, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.35, five_min_avg=3.77, fifteen_min_avg=3.09, cpu_share=13.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:15:08.133 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7884312, partition_space_available_1k=73206172, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22128, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19580, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51812, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6232580, free=2176172, buffers=277880, cached=7489008, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.66, five_min_avg=3.77, fifteen_min_avg=3.13, cpu_share=12.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:16:08.111 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7890640, partition_space_available_1k=73199844, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22072, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19580, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51820, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6227088, free=2170808, buffers=277884, cached=7499860, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.15, five_min_avg=3.63, fifteen_min_avg=3.12, cpu_share=12.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:17:08.133 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7895420, partition_space_available_1k=73195064, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22152, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19580, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51820, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6248540, free=2144740, buffers=277884, cached=7504476, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.84, five_min_avg=3.73, fifteen_min_avg=3.19, cpu_share=12.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:18:08.143 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7900356, partition_space_available_1k=73190128, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22184, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19580, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51848, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6264176, free=2119152, buffers=277896, cached=7514416, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.82, five_min_avg=3.76, fifteen_min_avg=3.23, cpu_share=12.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:19:08.154 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7910264, partition_space_available_1k=73180220, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22212, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19580, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51848, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6251192, free=2127060, buffers=277900, cached=7519488, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.99, five_min_avg=3.77, fifteen_min_avg=3.26, cpu_share=12.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:20:08.173 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7914900, partition_space_available_1k=73175584, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22384, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19580, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51848, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6252608, free=2120460, buffers=277916, cached=7524656, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.01, five_min_avg=3.87, fifteen_min_avg=3.34, cpu_share=12.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:21:08.172 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7925664, partition_space_available_1k=73164820, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22444, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19580, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51856, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6228852, free=2137576, buffers=277920, cached=7531292, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.67, five_min_avg=4.1, fifteen_min_avg=3.45, cpu_share=12.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:22:08.188 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7932912, partition_space_available_1k=73157572, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22420, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19580, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51860, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6262100, free=2092476, buffers=277924, cached=7543140, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.6, five_min_avg=3.89, fifteen_min_avg=3.42, cpu_share=12.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:23:08.188 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7938448, partition_space_available_1k=73152036, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22376, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19580, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51860, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6283132, free=2065616, buffers=277924, cached=7548968, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.84, five_min_avg=3.86, fifteen_min_avg=3.44, cpu_share=12.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:24:08.210 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7944140, partition_space_available_1k=73146344, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22472, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19580, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51868, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6285676, free=2062108, buffers=277928, cached=7549928, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.11, five_min_avg=3.92, fifteen_min_avg=3.48, cpu_share=12.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:25:08.222 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7951144, partition_space_available_1k=73139340, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22348, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19580, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51868, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6277924, free=2062424, buffers=277928, cached=7557364, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.36, five_min_avg=3.71, fifteen_min_avg=3.44, cpu_share=12.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:26:08.223 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7961872, partition_space_available_1k=73128612, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22360, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19580, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51872, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6311520, free=2022856, buffers=277932, cached=7563332, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.75, five_min_avg=3.75, fifteen_min_avg=3.47, cpu_share=12.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:27:08.231 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7963176, partition_space_available_1k=73127308, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22316, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19580, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51876, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6302140, free=2021300, buffers=277940, cached=7574260, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.53, five_min_avg=3.66, fifteen_min_avg=3.45, cpu_share=12.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:28:08.241 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7965660, partition_space_available_1k=73124824, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22332, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19580, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51876, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6310924, free=2004560, buffers=277940, cached=7582216, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.39, five_min_avg=3.61, fifteen_min_avg=3.45, cpu_share=12.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:29:08.250 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7975848, partition_space_available_1k=73114636, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22356, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19584, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51880, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6260728, free=2054448, buffers=277940, cached=7582524, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.16, five_min_avg=3.51, fifteen_min_avg=3.43, cpu_share=12.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:30:08.262 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7981056, partition_space_available_1k=73109428, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22228, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19584, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51888, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6279744, free=2025028, buffers=277940, cached=7592928, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.33, five_min_avg=3.5, fifteen_min_avg=3.43, cpu_share=12.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:31:08.261 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7991336, partition_space_available_1k=73099148, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22212, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19584, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51888, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6297124, free=2001708, buffers=277940, cached=7598868, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.5, five_min_avg=3.55, fifteen_min_avg=3.45, cpu_share=12.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:32:08.255 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7998272, partition_space_available_1k=73092212, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22204, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19584, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51892, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6311500, free=1975576, buffers=277940, cached=7610624, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.19, five_min_avg=3.46, fifteen_min_avg=3.43, cpu_share=12.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:33:08.260 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8014068, partition_space_available_1k=73076416, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22272, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19584, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51888, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6258832, free=2012212, buffers=277944, cached=7626652, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.37, five_min_avg=3.48, fifteen_min_avg=3.44, cpu_share=13.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:34:08.263 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8025704, partition_space_available_1k=73064780, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22420, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19588, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51896, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6231776, free=2036668, buffers=277944, cached=7629252, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.85, five_min_avg=3.66, fifteen_min_avg=3.51, cpu_share=12.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:35:08.276 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8032360, partition_space_available_1k=73058124, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22312, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19592, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51896, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6228712, free=2028272, buffers=277948, cached=7640708, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.99, five_min_avg=3.46, fifteen_min_avg=3.45, cpu_share=12.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:36:08.286 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8043788, partition_space_available_1k=73046696, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22308, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19592, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51896, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6217724, free=2032284, buffers=277948, cached=7647684, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.08, five_min_avg=3.42, fifteen_min_avg=3.44, cpu_share=12.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:37:08.281 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8039660, partition_space_available_1k=73050824, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22460, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19592, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51896, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6282352, free=1957260, buffers=277948, cached=7658080, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.51, five_min_avg=3.5, fifteen_min_avg=3.46, cpu_share=12.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:38:08.283 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8045840, partition_space_available_1k=73044644, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22496, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19592, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51900, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6293292, free=1944672, buffers=277948, cached=7659728, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.11, five_min_avg=3.74, fifteen_min_avg=3.55, cpu_share=12.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:39:08.278 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8055784, partition_space_available_1k=73034700, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22400, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19596, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51900, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6270012, free=1957824, buffers=277948, cached=7669856, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.91, five_min_avg=3.76, fifteen_min_avg=3.57, cpu_share=12.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:40:08.292 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8061204, partition_space_available_1k=73029280, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22304, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19596, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51904, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6301764, free=1920792, buffers=277948, cached=7675136, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.69, five_min_avg=3.77, fifteen_min_avg=3.59, cpu_share=12.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:41:08.284 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8071236, partition_space_available_1k=73019248, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22500, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19596, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51904, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6311932, free=1904856, buffers=277948, cached=7680904, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.41, five_min_avg=3.7, fifteen_min_avg=3.58, cpu_share=12.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:42:08.284 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8076356, partition_space_available_1k=73014128, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22284, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19596, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51908, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6317228, free=1889120, buffers=277948, cached=7691344, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.42, five_min_avg=3.66, fifteen_min_avg=3.57, cpu_share=12.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:43:08.284 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8083724, partition_space_available_1k=73006760, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22344, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19596, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51908, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6307328, free=1891560, buffers=277948, cached=7698804, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.31, five_min_avg=3.6, fifteen_min_avg=3.55, cpu_share=12.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:44:08.284 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8090336, partition_space_available_1k=73000148, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22464, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19600, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51908, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6308268, free=1888900, buffers=277948, cached=7700524, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.45, five_min_avg=3.57, fifteen_min_avg=3.55, cpu_share=12.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:45:08.322 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8101160, partition_space_available_1k=72989324, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22408, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19600, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51916, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6316128, free=1875256, buffers=277952, cached=7706304, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.07, five_min_avg=3.45, fifteen_min_avg=3.51, cpu_share=12.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:46:08.307 7ffbf266fdf0 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8106632, partition_space_available_1k=72983852, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22452, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19600, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24000, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51912, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6337184, free=1843668, buffers=277952, cached=7716836, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.98, five_min_avg=3.36, fifteen_min_avg=3.47, cpu_share=12.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:47:21.118 7f3f67862f20 [contrail-control-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 01/20/2025 01:47:21.118 7f3f67862f20 [contrail-control-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 01/20/2025 01:47:21.118 7f3f67862f20 [contrail-control-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 01/20/2025 01:47:21.138 7f3f61c83748 [contrail-control-nodemgr] [ERROR]: Cannot write http_port 8101 to /tmp/contrail-control-nodemgr.0.http_port 01/20/2025 01:47:21.139 7f3f61c83748 [contrail-control-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8101 01/20/2025 01:47:21.150 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvStart] in state[none] 01/20/2025 01:47:21.151 7f3f60690048 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectBgpRouter:NodeStatusUVE] map 01/20/2025 01:47:21.151 7f3f60690048 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 01:47:21.152 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 01/20/2025 01:47:21.152 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:21.159 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 01:47:21.159 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:21.159 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:21.159 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 01/20/2025 01:47:21.159 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:22.892 7f3f67862f20 [contrail-control-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-control', 'group': 'contrail-control', 'pid': 19140985496145716636187149272654245922758771848541344294350853972611144174966, 'start': '1737337637000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-dns', 'group': 'contrail-dns', 'pid': 114084692060356175520662642385921189929214827733546583976269148258353650333251, 'start': '1737337637000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-named', 'group': 'contrail-named', 'pid': 81877986201981186395552062726239170719310797874084898725203248385806006037053, 'start': '1737337636000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-control-nodemgr', 'group': 'contrail-control-nodemgr', 'pid': 90576548377340355038481826125717213888150492487734243117501024228744003738557, 'start': '1737337636000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 01/20/2025 01:47:23.461 7f3f67862f20 [contrail-control-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2650-3', _node_type='Control', _instance_id='0', _timestamp=1737337643461319, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-control-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 01/20/2025 01:47:23.462 7f3f67862f20 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2650-3', _node_type='Control', _instance_id='0', _timestamp=1737337643462022, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337637000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337637000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337636000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337636000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-16 01:14:15.868302", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7545-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 01/20/2025 01:47:23.464 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:23.471 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-16 01:14:15.868302", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7545-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 4 num_core_per_socket = 4 num_thread_per_core = 1 >> running_package_version = nightly.r24.1.centos-nightly_r24.1_centos.el7 installed_package_version = nightly.r24.1.centos-nightly_r24.1_centos.el7 >> 01/20/2025 01:47:23.472 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:23.474 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:23.475 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 01:47:23.475 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:23.476 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:23.477 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 deleted = False process_info = [ << process_name = contrail-control process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737337637000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-dns process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737337637000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-named process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737337636000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-control-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737337636000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-16 01:14:15.868302", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7545-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} >> 01/20/2025 01:47:23.477 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:25.151 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:47:25.152 7f3f60690048 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 01/20/2025 01:47:25.153 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:47:25.153 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:47:25.153 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:47:25.153 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:47:25.153 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/20/2025 01:47:25.153 7f3f60690048 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 01/20/2025 01:47:25.153 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/20/2025 01:47:25.154 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:47:25.154 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:47:31.591 7f3f67862f20 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2650-3', _node_type='Control', _instance_id='0', _timestamp=1737337651591623, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337637000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337637000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337636000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337636000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-16 01:14:15.868302", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7545-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 01/20/2025 01:47:31.592 7f3f67862f20 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8031136, partition_space_available_1k=73059348, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=['/var/crashes/core.contrail-collec.1.cn-jenkins-deploy-platform-ansible-os-2650-3.1737337623'], build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14180, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=13532, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20004, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43820, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=4672852, free=3595820, buffers=278056, cached=7628912, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=13.79, five_min_avg=5.92, fifteen_min_avg=4.31, cpu_share=0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:47:31.592 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:47:31.592 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:47:31.592 7f3f6064f548 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/20/2025 01:47:31.593 7f3f6064f548 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/20/2025 01:47:34.886 7f3f6064f448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connection Closed 01/20/2025 01:47:34.887 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 01/20/2025 01:47:34.888 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 01/20/2025 01:47:34.888 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:34.888 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down >>, ] >> 01/20/2025 01:47:34.888 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:34.888 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:34.888 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 01:47:34.888 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:38.889 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:47:38.890 7f3f60690048 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 01/20/2025 01:47:38.890 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:47:38.890 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:47:38.890 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:47:38.890 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:47:38.890 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/20/2025 01:47:38.891 7f3f60690048 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 01/20/2025 01:47:38.891 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/20/2025 01:47:38.891 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:47:38.891 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:47:38.904 7f3f6064f448 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001017 01/20/2025 01:47:38.905 7f3f6064f448 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/20/2025 01:47:38.905 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 01/20/2025 01:47:38.905 7f3f60690048 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 01/20/2025 01:47:38.905 7f3f60690048 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 01/20/2025 01:47:38.905 7f3f60690048 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 01:47:38.905 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 01/20/2025 01:47:38.906 7f3f60690448 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/20/2025 01:47:38.907 7f3f60690448 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/20/2025 01:48:31.566 7f3f67862f20 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=9038616, partition_space_available_1k=72051868, percentage_partition_space_used=11, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20408, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18944, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21692, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43960, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5431636, free=1551184, buffers=337692, cached=8855128, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=16.98, five_min_avg=8.37, fifteen_min_avg=5.27, cpu_share=24.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:49:31.551 7f3f67862f20 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10147132, partition_space_available_1k=70943352, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21012, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19232, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21692, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43980, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5753768, free=182808, buffers=387652, cached=9851412, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=11.34, five_min_avg=8.26, fifteen_min_avg=5.42, cpu_share=16.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:50:15.036 7f3f6064f448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connection Closed 01/20/2025 01:50:15.037 7f3f60690448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Established] 01/20/2025 01:50:15.038 7f3f60690448 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 01/20/2025 01:50:15.038 7f3f60690448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[Established] -> State[Connect] 01/20/2025 01:50:15.038 7f3f60690448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:15.038 7f3f60690448 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Established to Connect on EvTcpClose >>, ] description = Collector:Collector[Established to Connect on EvTcpClose] connection down >>, ] >> 01/20/2025 01:50:15.038 7f3f60690448 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:15.038 7f3f60690448 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/20/2025 01:50:15.039 7f3f60690448 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 01/20/2025 01:50:15.039 7f3f60690448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/20/2025 01:50:15.039 7f3f60690448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:50:15.039 7f3f60690448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:50:15.173 7f3f6064f448 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001017 01/20/2025 01:50:15.174 7f3f6064f448 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/20/2025 01:50:15.174 7f3f60690448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 01/20/2025 01:50:15.174 7f3f60690448 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 01/20/2025 01:50:15.174 7f3f60690448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 01/20/2025 01:50:15.174 7f3f60690448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 01:50:15.175 7f3f60690448 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 01/20/2025 01:50:15.175 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/20/2025 01:50:15.176 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/20/2025 01:50:15.231 7f3f6064f448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connection Closed 01/20/2025 01:50:15.232 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Established] 01/20/2025 01:50:15.233 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:50:15.233 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[Established] -> State[Connect] 01/20/2025 01:50:15.233 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:15.233 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Established to Connect on EvTcpClose >>, ] description = Collector:Collector[Established to Connect on EvTcpClose] connection down >>, ] >> 01/20/2025 01:50:15.233 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:15.234 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:50:15.234 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:50:15.234 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:15.234 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:50:15.234 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:15.234 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:15.234 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 3 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:50:15.234 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:19.237 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:50:19.239 7f3f60690048 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 01/20/2025 01:50:19.240 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:50:19.240 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:19.240 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:50:19.240 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:19.240 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/20/2025 01:50:19.240 7f3f60690048 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 01/20/2025 01:50:19.241 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/20/2025 01:50:19.241 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:50:19.241 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:50:27.995 7f3f6064f448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connection Closed 01/20/2025 01:50:27.996 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 01/20/2025 01:50:27.997 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 01/20/2025 01:50:27.997 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:27.997 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down >>, ] >> 01/20/2025 01:50:27.997 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:27.997 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:27.997 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:50:27.997 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:31.521 7f3f67862f20 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2650-3', _node_type='Control', _instance_id='0', _timestamp=1737337831521621, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337637000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337637000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337636000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337636000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-16 01:14:15.868302", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7545-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 01/20/2025 01:50:31.522 7f3f67862f20 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10475216, partition_space_available_1k=70615268, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=['/var/crashes/core.contrail-collec.1.cn-jenkins-deploy-platform-ansible-os-2650-3.1737337623', '/var/crashes/core.contrail-collec.1.cn-jenkins-deploy-platform-ansible-os-2650-3.1737337815'], build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21920, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19664, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21692, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43992, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=4999448, free=1045192, buffers=387204, cached=9743796, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.81, five_min_avg=7.29, fifteen_min_avg=5.27, cpu_share=11.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:50:31.522 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:31.522 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 deleted = False process_info = [ << process_name = contrail-control process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737337637000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-dns process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737337637000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-named process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737337636000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-control-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737337636000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-16 01:14:15.868302", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7545-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} >> 01/20/2025 01:50:31.522 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:31.522 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:31.522 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 10475216 partition_space_available_1k = 70615268 percentage_partition_space_used = 13 >> } all_core_file_list = [ /var/crashes/core.contrail-collec.1.cn-jenkins-deploy-platform-ansible-os-2650-3.1737337623, /var/crashes/core.contrail-collec.1.cn-jenkins-deploy-platform-ansible-os-2650-3.1737337815, ] process_mem_cpu_usage = { contrail-control : << mem_virt = 21920 cpu_share = 0 mem_res = 0 >>contrail-dns : << mem_virt = 19664 cpu_share = 0 mem_res = 0 >>contrail-named : << mem_virt = 21692 cpu_share = 0 mem_res = 0 >>contrail-control-nodemgr : << mem_virt = 43992 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 16175640 used = 4999448 free = 1045192 buffers = 387204 cached = 9743796 node_type = control-node >> system_cpu_usage = << one_min_avg = 5.81 five_min_avg = 7.29 fifteen_min_avg = 5.27 cpu_share = 11.0 node_type = control-node >> >> 01/20/2025 01:50:31.522 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:31.997 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:50:31.998 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:50:31.999 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:50:31.999 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:31.999 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:50:31.999 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:31.999 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:50:31.999 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:50:31.999 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:32.000 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:50:32.000 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:32.000 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:32.000 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:50:32.000 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:35.999 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:50:36.001 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:50:36.003 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:50:36.003 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:36.003 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:50:36.003 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:36.003 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:50:36.004 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:50:36.004 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:36.004 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:50:36.004 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:36.004 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:36.004 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:50:36.004 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:40.004 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:50:40.005 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:50:40.006 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:50:40.006 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:40.006 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:50:40.006 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:40.006 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:50:40.006 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:50:40.006 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:40.006 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:50:40.007 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:40.007 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:40.007 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:50:40.007 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:44.006 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:50:44.007 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:50:44.008 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:50:44.008 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:44.008 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:50:44.008 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:44.008 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:50:44.008 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:50:44.008 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:44.009 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:50:44.009 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:44.009 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:44.009 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:50:44.009 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:48.012 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:50:48.013 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:50:48.013 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:50:48.013 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:48.013 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:50:48.013 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:48.014 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:50:48.014 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:50:48.014 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:48.014 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:50:48.014 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:48.014 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:48.014 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:50:48.014 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:52.014 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:50:52.016 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:50:52.016 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:50:52.016 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:52.016 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:50:52.016 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:52.016 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:50:52.017 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:50:52.017 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:52.017 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:50:52.017 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:52.017 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:52.017 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:50:52.017 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:56.017 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:50:56.018 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:50:56.018 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:50:56.018 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:56.018 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:50:56.018 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:56.018 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:50:56.019 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:50:56.019 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:56.019 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:50:56.019 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:56.019 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:56.019 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:50:56.019 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:00.020 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:51:00.022 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:51:00.022 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:51:00.022 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:00.022 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:51:00.022 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:00.022 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:51:00.022 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:51:00.022 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:00.023 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:51:00.023 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:00.023 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:00.023 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:51:00.023 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:04.025 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:51:04.026 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:51:04.027 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:51:04.027 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:04.027 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:51:04.027 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:04.027 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:51:04.027 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:51:04.027 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:04.028 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:51:04.028 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:04.028 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:04.028 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:51:04.028 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:08.029 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:51:08.030 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:51:08.030 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:51:08.030 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:08.030 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:51:08.030 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:08.030 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:51:08.031 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:51:08.031 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:08.031 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:51:08.031 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:08.031 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:08.031 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:51:08.031 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:12.033 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:51:12.034 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:51:12.034 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:51:12.034 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:12.034 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:51:12.034 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:12.034 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:51:12.035 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:51:12.035 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:12.035 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:51:12.035 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:12.035 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:12.035 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:51:12.035 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:16.037 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:51:16.038 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:51:16.039 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:51:16.039 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:16.039 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:51:16.039 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:16.039 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:51:16.039 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:51:16.039 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:16.040 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:51:16.040 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:16.040 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:16.040 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:51:16.040 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:20.041 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:51:20.042 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:51:20.042 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:51:20.042 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:20.042 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:51:20.043 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:20.043 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:51:20.043 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:51:20.043 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:20.043 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:51:20.043 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:20.043 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:20.043 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:51:20.043 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:24.043 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:51:24.045 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:51:24.045 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:51:24.045 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:24.045 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:51:24.045 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:24.045 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:51:24.045 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:51:24.046 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:24.046 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:51:24.046 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:24.046 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:24.046 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:51:24.046 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:28.046 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:51:28.048 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:51:28.048 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:51:28.048 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:28.048 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:51:28.048 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:28.048 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:51:28.049 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:51:28.049 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:28.049 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:51:28.049 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:28.049 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:28.049 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:51:28.049 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:30.529 7f3f67862f20 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10364556, partition_space_available_1k=70725928, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22428, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20132, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21692, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44044, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=4188896, free=1915368, buffers=391216, cached=9680160, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.67, five_min_avg=6.09, fifteen_min_avg=4.98, cpu_share=4.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:51:30.529 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:30.529 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 10364556 partition_space_available_1k = 70725928 percentage_partition_space_used = 13 >> } process_mem_cpu_usage = { contrail-control : << mem_virt = 22428 cpu_share = 0 mem_res = 0 >>contrail-dns : << mem_virt = 20132 cpu_share = 0 mem_res = 0 >>contrail-named : << mem_virt = 21692 cpu_share = 0 mem_res = 0 >>contrail-control-nodemgr : << mem_virt = 44044 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 16175640 used = 4188896 free = 1915368 buffers = 391216 cached = 9680160 node_type = control-node >> system_cpu_usage = << one_min_avg = 2.67 five_min_avg = 6.09 fifteen_min_avg = 4.98 cpu_share = 4.0 node_type = control-node >> >> 01/20/2025 01:51:30.529 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:32.048 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:51:32.049 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:51:32.050 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:51:32.050 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:32.050 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:51:32.050 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:32.050 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:51:32.050 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:51:32.050 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:32.050 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:51:32.050 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:32.051 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:32.051 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:51:32.051 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:36.053 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:51:36.054 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:51:36.054 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:51:36.054 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:36.054 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:51:36.054 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:36.054 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:51:36.054 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:51:36.054 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:36.055 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:51:36.055 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:36.055 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:36.055 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:51:36.055 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:40.057 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:51:40.058 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:51:40.058 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:51:40.058 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:40.058 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:51:40.059 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:40.059 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:51:40.059 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:51:40.059 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:40.059 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:51:40.059 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:40.059 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:40.059 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:51:40.059 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:44.059 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:51:44.061 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:51:44.061 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:51:44.061 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:44.061 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:51:44.061 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:44.061 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:51:44.061 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:51:44.062 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:44.062 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:51:44.062 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:44.062 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:44.062 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:51:44.062 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:48.062 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:51:48.064 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:51:48.064 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:51:48.064 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:48.064 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:51:48.064 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:48.064 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:51:48.065 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:51:48.065 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:48.065 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:51:48.065 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:48.065 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:48.065 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:51:48.065 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:52.065 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:51:52.066 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:51:52.066 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:51:52.066 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:52.067 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:51:52.067 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:52.067 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:51:52.067 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:51:52.067 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:52.067 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:51:52.067 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:52.067 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:52.068 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:51:52.068 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:56.069 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:51:56.070 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:51:56.070 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:51:56.070 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:56.071 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:51:56.071 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:56.071 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:51:56.071 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:51:56.071 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:56.071 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:51:56.071 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:56.071 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:56.071 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:51:56.071 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:00.072 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:52:00.073 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:52:00.073 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:52:00.073 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:00.073 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:52:00.073 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:00.073 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:52:00.074 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:52:00.074 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:00.074 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:52:00.074 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:00.074 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:00.074 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:52:00.074 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:04.076 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:52:04.077 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:52:04.077 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:52:04.077 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:04.077 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:52:04.077 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:04.077 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:52:04.078 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:52:04.078 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:04.078 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:52:04.078 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:04.078 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:04.078 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:52:04.078 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:08.078 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:52:08.080 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:52:08.080 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:52:08.080 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:08.080 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:52:08.080 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:08.080 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:52:08.080 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:52:08.080 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:08.081 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:52:08.081 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:08.081 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:08.081 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:52:08.081 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:12.081 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:52:12.082 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:52:12.082 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:52:12.082 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:12.082 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:52:12.082 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:12.083 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:52:12.083 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:52:12.083 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:12.083 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:52:12.083 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:12.083 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:12.083 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:52:12.083 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:16.085 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:52:16.086 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:52:16.086 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:52:16.087 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:16.087 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:52:16.087 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:16.087 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:52:16.087 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:52:16.087 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:16.087 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:52:16.087 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:16.088 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:16.088 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:52:16.088 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:20.087 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:52:20.090 7f3f60690048 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:52:20.090 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:52:20.090 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:20.090 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:52:20.090 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:20.090 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:52:20.091 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:52:20.091 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:20.091 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:52:20.091 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:20.091 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:20.091 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:52:20.091 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:24.090 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:52:24.092 7f3f60690048 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 01/20/2025 01:52:24.092 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:52:24.092 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:24.093 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:52:24.093 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:24.093 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/20/2025 01:52:24.093 7f3f60690048 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 01/20/2025 01:52:24.093 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/20/2025 01:52:24.094 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:52:24.094 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:52:27.088 7f3f6064f448 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connection Closed 01/20/2025 01:52:27.088 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 01/20/2025 01:52:27.089 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 01/20/2025 01:52:27.089 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:27.089 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down >>, ] >> 01/20/2025 01:52:27.089 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:27.089 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:27.089 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8101 start_time = 1737337641151781 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:52:27.089 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:30.570 7f3f67862f20 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10401252, partition_space_available_1k=70689232, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22968, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20440, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21692, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44100, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5074924, free=961572, buffers=395296, cached=9743848, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.05, five_min_avg=5.53, fifteen_min_avg=4.85, cpu_share=8.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:52:30.570 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:30.570 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 10401252 partition_space_available_1k = 70689232 percentage_partition_space_used = 13 >> } process_mem_cpu_usage = { contrail-control : << mem_virt = 22968 cpu_share = 0 mem_res = 0 >>contrail-dns : << mem_virt = 20440 cpu_share = 0 mem_res = 0 >>contrail-named : << mem_virt = 21692 cpu_share = 0 mem_res = 0 >>contrail-control-nodemgr : << mem_virt = 44100 cpu_share = 0 mem_res = 0 >> } system_mem_usage = << total = 16175640 used = 5074924 free = 961572 buffers = 395296 cached = 9743848 node_type = control-node >> system_cpu_usage = << one_min_avg = 3.05 five_min_avg = 5.53 fifteen_min_avg = 4.85 cpu_share = 8.25 node_type = control-node >> >> 01/20/2025 01:52:30.570 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:31.089 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:52:31.100 7f3f60690048 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 01/20/2025 01:52:31.100 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:52:31.100 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:31.100 7f3f60690048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:52:31.100 7f3f60690048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:31.100 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/20/2025 01:52:31.100 7f3f60690048 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 01/20/2025 01:52:31.101 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/20/2025 01:52:31.101 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:52:31.101 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:52:31.106 7f3f6064f448 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001017 01/20/2025 01:52:31.107 7f3f6064f448 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/20/2025 01:52:31.107 7f3f60690048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 01/20/2025 01:52:31.107 7f3f60690048 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 01/20/2025 01:52:31.107 7f3f60690048 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 01/20/2025 01:52:31.107 7f3f60690048 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 01:52:31.108 7f3f60690048 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 01/20/2025 01:52:31.108 7f3f60690448 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/20/2025 01:52:31.109 7f3f60690448 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/20/2025 01:52:36.725 7f3f6064f448 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001296 01/20/2025 01:52:36.725 7f3f6064f448 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/20/2025 01:52:36.726 7f3f60690448 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 01/20/2025 01:52:36.726 7f3f60690448 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 01/20/2025 01:52:36.726 7f3f60690448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 01/20/2025 01:52:36.726 7f3f60690448 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 01:53:30.544 7f3f67862f20 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10537964, partition_space_available_1k=70552520, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=23740, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20608, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21692, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44232, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5909296, free=481288, buffers=396916, cached=9388140, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.57, five_min_avg=4.97, fifteen_min_avg=4.7, cpu_share=10.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:54:30.551 7f3f67862f20 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10861632, partition_space_available_1k=70228852, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24124, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20656, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21692, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44372, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5979792, free=384392, buffers=407268, cached=9404188, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.9, five_min_avg=4.55, fifteen_min_avg=4.57, cpu_share=8.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:55:02.485 7ffbc81f5848 [contrail-control-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 01/20/2025 01:55:02.486 7ffbc81f5848 [contrail-control-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 01/20/2025 01:55:02.486 7ffbc81f5848 [contrail-control-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 01/20/2025 01:55:02.497 7ffbc5b99438 [contrail-control-nodemgr] [ERROR]: Cannot write http_port 8101 to /tmp/contrail-control-nodemgr.0.http_port 01/20/2025 01:55:02.497 7ffbc5b99438 [contrail-control-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8101 01/20/2025 01:55:02.498 7ffbc5ba8d68 [contrail-control-nodemgr] [INFO]: Processing event[EvStart] in state[none] 01/20/2025 01:55:02.500 7ffbc5ba8d68 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectBgpRouter:NodeStatusUVE] map 01/20/2025 01:55:02.500 7ffbc5ba8d68 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 01:55:02.501 7ffbc5ba8d68 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 01/20/2025 01:55:02.501 7ffbc5ba8d68 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:55:02.501 7ffbc5ba8d68 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 01:55:02.501 7ffbc5ba8d68 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:55:02.501 7ffbc5ba8d68 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:55:02.501 7ffbc5ba8d68 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737338102500667 collector_name = collector_ip = collector_list = [ 10.0.0.22:8086, 10.0.0.49:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 01/20/2025 01:55:02.502 7ffbc5ba8d68 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:55:02.628 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-control', 'group': 'contrail-control', 'pid': 16719777929583472933706716394397743101573254045852472500903250473610500321806, 'start': '1737338099000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-dns', 'group': 'contrail-dns', 'pid': 98952865827638211117740759052000320261127398111068303395816849944549650808986, 'start': '1737338099000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-named', 'group': 'contrail-named', 'pid': 7249936600264756424308159602151099463660290751119065930954721456006300952801, 'start': '1737338100000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-control-nodemgr', 'group': 'contrail-control-nodemgr', 'pid': 42926147652545340122598714230664150576937231611988115973030537948197564387775, 'start': '1737338099000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 01/20/2025 01:55:02.769 7ffbc81f5848 [contrail-control-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2650-3', _node_type='Control', _instance_id='0', _timestamp=1737338102769058, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-control-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 01/20/2025 01:55:02.769 7ffbc81f5848 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2650-3', _node_type='Control', _instance_id='0', _timestamp=1737338102769747, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737338099000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737338099000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737338100000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737338099000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-01-20 00:44:39.080355", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7550-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 01/20/2025 01:55:02.772 7ffbce4c9a20 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:55:02.773 7ffbce4c9a20 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-01-20 00:44:39.080355", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7550-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 4 num_core_per_socket = 4 num_thread_per_core = 1 >> running_package_version = nightly-nightly.el7 installed_package_version = nightly-nightly.el7 >> 01/20/2025 01:55:02.774 7ffbce4c9a20 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:55:02.774 7ffbce4c9a20 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:55:02.774 7ffbce4c9a20 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 01:55:02.774 7ffbce4c9a20 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:55:02.774 7ffbce4c9a20 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:55:02.774 7ffbce4c9a20 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 deleted = False process_info = [ << process_name = contrail-control process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737338099000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-dns process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737338099000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-named process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737338100000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-control-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737338099000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-01-20 00:44:39.080355", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7550-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 01/20/2025 01:55:02.774 7ffbce4c9a20 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:55:06.500 7ffbc46c44e0 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:55:06.502 7ffbc46c44e0 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 01/20/2025 01:55:06.502 7ffbc46c44e0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:55:06.502 7ffbc46c44e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:55:06.502 7ffbc46c44e0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:55:06.502 7ffbc46c44e0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:55:06.502 7ffbc46c44e0 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/20/2025 01:55:06.503 7ffbc46c44e0 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 01/20/2025 01:55:06.503 7ffbc46c44e0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/20/2025 01:55:06.503 7ffbc46c44e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:55:06.503 7ffbc46c44e0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:55:06.507 7ffbc46d3e10 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001017 01/20/2025 01:55:06.507 7ffbc46d3e10 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/20/2025 01:55:06.508 7ffbbf947978 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 01/20/2025 01:55:06.508 7ffbbf947978 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 01/20/2025 01:55:06.508 7ffbbf947978 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 01/20/2025 01:55:06.508 7ffbbf947978 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 01:55:06.508 7ffbbf947978 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 01/20/2025 01:55:06.508 7ffbc46d32e8 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/20/2025 01:55:06.509 7ffbc46d32e8 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/20/2025 01:55:09.801 7ffbc81f5848 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2650-3', _node_type='Control', _instance_id='0', _timestamp=1737338109801423, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737338099000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737338099000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737338100000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737338099000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-01-20 00:44:39.080355", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7550-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 01/20/2025 01:55:09.801 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10976792, partition_space_available_1k=70113692, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=['/var/crashes/core.contrail-collec.1.cn-jenkins-deploy-platform-ansible-os-2650-3.1737337623', '/var/crashes/core.contrail-collec.1.cn-jenkins-deploy-platform-ansible-os-2650-3.1737337815'], build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=15796, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=15716, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52180, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5993332, free=391920, buffers=409612, cached=9380776, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.44, five_min_avg=4.23, fifteen_min_avg=4.46, cpu_share=0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:55:09.802 7ffbc5b0c828 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/20/2025 01:55:09.802 7ffbc5b0c828 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/20/2025 01:56:09.813 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10982888, partition_space_available_1k=70107596, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16488, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=15960, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52152, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5925648, free=449920, buffers=409672, cached=9390400, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.06, five_min_avg=3.83, fifteen_min_avg=4.31, cpu_share=7.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:57:09.827 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10978612, partition_space_available_1k=70111872, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16812, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16304, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52152, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6017268, free=354460, buffers=409696, cached=9394216, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.46, five_min_avg=3.34, fifteen_min_avg=4.11, cpu_share=6.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:58:09.840 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10981876, partition_space_available_1k=70108608, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17256, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16840, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52152, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=6024256, free=362776, buffers=408936, cached=9379672, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.12, five_min_avg=2.91, fifteen_min_avg=3.91, cpu_share=7.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 01:59:09.850 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11766088, partition_space_available_1k=69324396, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17552, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17936, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51860, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=3832036, free=2603556, buffers=415900, cached=9324148, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.23, five_min_avg=2.97, fifteen_min_avg=3.87, cpu_share=10.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:00:09.875 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12161676, partition_space_available_1k=68928808, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17832, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18152, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51956, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5196524, free=750156, buffers=431272, cached=9797688, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.95, five_min_avg=3.77, fifteen_min_avg=4.11, cpu_share=16.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:01:09.877 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12184028, partition_space_available_1k=68906456, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17932, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18152, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51972, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5271440, free=669912, buffers=431276, cached=9803012, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.78, five_min_avg=3.39, fifteen_min_avg=3.95, cpu_share=6.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:02:09.883 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12187812, partition_space_available_1k=68902672, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17984, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18232, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51956, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5653760, free=372144, buffers=430812, cached=9718924, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.69, five_min_avg=2.99, fifteen_min_avg=3.78, cpu_share=7.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:03:09.892 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12191020, partition_space_available_1k=68899464, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17920, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18232, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51968, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5670620, free=366696, buffers=430852, cached=9707472, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.09, five_min_avg=2.58, fifteen_min_avg=3.59, cpu_share=5.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:04:09.904 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12194028, partition_space_available_1k=68896456, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17984, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18288, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51976, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5675072, free=373340, buffers=430828, cached=9696400, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.68, five_min_avg=2.2, fifteen_min_avg=3.39, cpu_share=5.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:05:09.923 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12192864, partition_space_available_1k=68897620, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17948, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18316, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51988, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5697452, free=356620, buffers=430832, cached=9690736, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.8, five_min_avg=1.95, fifteen_min_avg=3.23, cpu_share=5.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:06:09.920 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12197544, partition_space_available_1k=68892940, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17976, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18356, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52000, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5658752, free=391796, buffers=430832, cached=9694260, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.92, five_min_avg=1.76, fifteen_min_avg=3.08, cpu_share=5.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:07:09.924 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12200988, partition_space_available_1k=68889496, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17992, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18396, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52004, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5676556, free=384024, buffers=430748, cached=9684312, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.87, five_min_avg=1.57, fifteen_min_avg=2.93, cpu_share=5.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:08:09.929 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12203976, partition_space_available_1k=68886508, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18064, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18396, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52004, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5696408, free=363348, buffers=430620, cached=9685264, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.96, five_min_avg=1.46, fifteen_min_avg=2.81, cpu_share=5.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:09:09.939 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12207648, partition_space_available_1k=68882836, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18184, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18400, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52004, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5680172, free=382232, buffers=430352, cached=9682884, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.68, five_min_avg=1.29, fifteen_min_avg=2.66, cpu_share=5.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:10:09.950 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12211704, partition_space_available_1k=68878780, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18196, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18400, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52000, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5709836, free=361660, buffers=430264, cached=9673880, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.77, five_min_avg=1.19, fifteen_min_avg=2.54, cpu_share=5.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:11:09.952 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12216704, partition_space_available_1k=68873780, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18192, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18400, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51992, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5715580, free=378476, buffers=430252, cached=9651332, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.81, five_min_avg=1.11, fifteen_min_avg=2.42, cpu_share=5.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:12:09.957 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12220476, partition_space_available_1k=68870008, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18196, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18400, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51996, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5724916, free=382824, buffers=430572, cached=9637328, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.92, five_min_avg=1.09, fifteen_min_avg=2.33, cpu_share=6.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:13:09.962 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12218784, partition_space_available_1k=68871700, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18252, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18412, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51992, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5733272, free=376972, buffers=430588, cached=9634808, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.75, five_min_avg=1.01, fifteen_min_avg=2.22, cpu_share=5.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:14:09.968 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12222544, partition_space_available_1k=68867940, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18240, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18416, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52000, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5728284, free=378004, buffers=430588, cached=9638764, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.91, five_min_avg=0.99, fifteen_min_avg=2.14, cpu_share=4.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:14:56.614 7ffbc45520f0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 01/20/2025 02:15:09.978 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12580836, partition_space_available_1k=68509648, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18656, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18428, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51900, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5749292, free=399848, buffers=434380, cached=9592120, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.15, five_min_avg=1.0, fifteen_min_avg=2.07, cpu_share=6.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:15:27.046 7ffbc8066a20 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 01/20/2025 02:15:52.351 7ffbc46a9390 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 01/20/2025 02:16:03.775 7ffbc46ce6d8 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 01/20/2025 02:16:09.971 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12589364, partition_space_available_1k=68501120, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18828, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18432, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51900, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5747536, free=393972, buffers=434948, cached=9599184, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.06, five_min_avg=1.0, fifteen_min_avg=2.0, cpu_share=6.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:17:09.975 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12591636, partition_space_available_1k=68498848, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18784, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18456, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51908, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5768856, free=369244, buffers=434948, cached=9602592, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.78, five_min_avg=0.93, fifteen_min_avg=1.91, cpu_share=5.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:17:33.932 7ffbbfb234e0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 01/20/2025 02:18:09.982 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12597248, partition_space_available_1k=68493236, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19380, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18584, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51900, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5788824, free=376512, buffers=433800, cached=9576504, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.93, five_min_avg=0.93, fifteen_min_avg=1.85, cpu_share=6.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:19:09.987 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12611528, partition_space_available_1k=68478956, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20228, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18868, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51888, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5910244, free=293064, buffers=434052, cached=9538280, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.3, five_min_avg=1.31, fifteen_min_avg=1.92, cpu_share=9.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:20:10.002 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12628660, partition_space_available_1k=68461824, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22164, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19248, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51880, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5865012, free=365772, buffers=434024, cached=9510832, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.6, five_min_avg=1.55, fifteen_min_avg=1.96, cpu_share=10.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:21:09.990 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12637572, partition_space_available_1k=68452912, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22972, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19548, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51868, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5871724, free=392928, buffers=434016, cached=9476972, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.7, five_min_avg=1.48, fifteen_min_avg=1.91, cpu_share=9.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:22:09.989 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12644792, partition_space_available_1k=68445692, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=23916, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19704, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16824, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51884, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5894020, free=361616, buffers=434020, cached=9485984, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.6, five_min_avg=1.5, fifteen_min_avg=1.89, cpu_share=9.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:23:09.994 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12654448, partition_space_available_1k=68436036, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24744, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20016, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16856, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51884, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5876400, free=374364, buffers=434028, cached=9490848, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.59, five_min_avg=1.53, fifteen_min_avg=1.87, cpu_share=9.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:24:10.004 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12680368, partition_space_available_1k=68410116, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=25448, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20160, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16856, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51884, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5948888, free=365020, buffers=433780, cached=9427952, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.93, five_min_avg=1.65, fifteen_min_avg=1.9, cpu_share=11.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:25:10.035 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12688620, partition_space_available_1k=68401864, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=25880, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20324, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16856, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51876, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5969144, free=360020, buffers=433780, cached=9412696, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.75, five_min_avg=1.68, fifteen_min_avg=1.89, cpu_share=8.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:25:31.590 7ffbc46b8d68 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 01/20/2025 02:26:10.031 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12697108, partition_space_available_1k=68393376, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=26032, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20420, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16856, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51864, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5969580, free=376188, buffers=433864, cached=9396008, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.39, five_min_avg=1.83, fifteen_min_avg=1.93, cpu_share=7.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:27:10.042 7ffbc81f5848 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-3', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12700716, partition_space_available_1k=68389768, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=25876, cpu_share=0, mem_res=0, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20472, cpu_share=0, mem_res=0, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16856, cpu_share=0, mem_res=0, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51872, cpu_share=0, mem_res=0, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175640, used=5950228, free=391744, buffers=433868, cached=9399800, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.57, five_min_avg=1.69, fifteen_min_avg=1.87, cpu_share=5.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 01/20/2025 02:27:54.900 7ffbc46d3048 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map