11/03/2025 01:37:40.239 7faa57fe0600 [contrail-control-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 11/03/2025 01:37:40.239 7faa57fe0600 [contrail-control-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 11/03/2025 01:37:40.239 7faa57fe0600 [contrail-control-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 11/03/2025 01:37:40.262 7faa549d6400 [contrail-control-nodemgr] [ERROR]: Cannot write http_port 8101 to /tmp/contrail-control-nodemgr.0.http_port 11/03/2025 01:37:40.263 7faa549d6400 [contrail-control-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8101 11/03/2025 01:37:40.264 7faa549d67c0 [contrail-control-nodemgr] [INFO]: Processing event[EvStart] in state[none] 11/03/2025 01:37:40.264 7faa549d67c0 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:37:40.265 7faa549d67c0 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 11/03/2025 01:37:40.265 7faa549d67c0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 11/03/2025 01:37:40.265 7faa549d67c0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:37:40.265 7faa549d67c0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-611-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 11/03/2025 01:37:40.265 7faa549d67c0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:37:40.265 7faa549d67c0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:37:40.265 7faa549d67c0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-611-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1762133860265154 collector_name = collector_ip = collector_list = [ 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 11/03/2025 01:37:40.265 7faa549d67c0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:37:40.331 7faa57fe0600 [contrail-control-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-control', 'group': 'contrail-control', 'pid': 7626391383994839749483555185341284070078243756229421334554138314631669391762, 'start': '1762133857000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-dns', 'group': 'contrail-dns', 'pid': 24670731085641242183063038486527425364785317625215998980578255239493948113715, 'start': '1762133857000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-named', 'group': 'contrail-named', 'pid': 70344225470897824986033283692124193132988503581285296299435646212804387191341, 'start': '1762133858000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-control-nodemgr', 'group': 'contrail-control-nodemgr', 'pid': 14532674850758367013045526190027571555471315399567340764929030701945793799216, 'start': '1762133857000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 11/03/2025 01:37:40.432 7faa57fe0600 [contrail-control-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-juju-os-611-1', _node_type='Control', _instance_id='0', _timestamp=1762133860432477, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-611-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-control-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 11/03/2025 01:37:40.433 7faa57fe0600 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-juju-os-611-1', _node_type='Control', _instance_id='0', _timestamp=1762133860433081, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-611-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1762133857000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1762133857000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1762133858000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1762133857000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-11-03 00:47:52.749276", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-12426-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed\n"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 11/03/2025 01:37:40.435 7faa549d6860 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:37:40.436 7faa549d6860 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-611-1 build_info = {"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-11-03 00:47:52.749276", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-12426-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed "}]} system_cpu_info = << num_socket = 1 num_cpu = 8 num_core_per_socket = 8 num_thread_per_core = 1 >> running_package_version = package contrail-lib is not installed installed_package_version = package contrail-lib is not installed >> 11/03/2025 01:37:40.437 7faa549d6860 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:37:40.437 7faa549d6860 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:37:40.437 7faa549d6860 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-611-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 11/03/2025 01:37:40.437 7faa549d6860 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:37:40.437 7faa549d6860 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:37:40.437 7faa549d6860 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-611-1 deleted = False process_info = [ << process_name = contrail-control process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1762133857000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-dns process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1762133857000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-named process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1762133858000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-control-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1762133857000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-11-03 00:47:52.749276", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-12426-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed "}]} >> 11/03/2025 01:37:40.437 7faa549d6860 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:37:44.265 7faa54897d60 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 01:37:44.266 7faa54897d60 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 01:37:44.266 7faa54897d60 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 01:37:44.266 7faa54897d60 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 01:37:44.267 7faa54897d60 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-611-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 01:37:44.267 7faa54897d60 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 01:37:44.267 7faa54897d60 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 01:37:44.267 7faa54897d60 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 01:37:44.267 7faa54897d60 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:37:44.267 7faa54897d60 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-611-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 01:37:44.267 7faa54897d60 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:37:44.267 7faa54897d60 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:37:44.267 7faa54897d60 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-611-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1762133860265154 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 11/03/2025 01:37:44.267 7faa54897d60 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:37:45.212 7faa54897d60 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:37:47.642 7faa57fe0600 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-juju-os-611-1', _node_type='Control', _instance_id='0', _timestamp=1762133867642814, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-611-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1762133857000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1762133857000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1762133858000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1762133857000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-11-03 00:47:52.749276", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-12426-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed\n"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 11/03/2025 01:37:47.643 7faa57fe0600 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-611-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=53825396, partition_space_available_1k=27265088, percentage_partition_space_used=66, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=551048, cpu_share=0.0, mem_res=4800, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=10012, cpu_share=0.0, mem_res=4360, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=10976, cpu_share=0.0, mem_res=8236, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50620, cpu_share=0.0, mem_res=41388, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=12114356, free=636760, buffers=632284, cached=19818756, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.71, five_min_avg=4.0, fifteen_min_avg=2.62, cpu_share=0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/03/2025 01:37:47.643 7faa54897680 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:37:47.643 7faa54897680 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-611-1 deleted = False process_info = [ << process_name = contrail-control process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1762133857000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-dns process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1762133857000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-named process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1762133858000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-control-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1762133857000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-11-03 00:47:52.749276", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-12426-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed "}]} >> 11/03/2025 01:37:47.643 7faa54897680 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:37:47.643 7faa54897680 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:37:47.643 7faa54897680 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-611-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 53825396 partition_space_available_1k = 27265088 percentage_partition_space_used = 66 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-control : << mem_virt = 551048 cpu_share = 0.0 mem_res = 4800 >>contrail-dns : << mem_virt = 10012 cpu_share = 0.0 mem_res = 4360 >>contrail-named : << mem_virt = 10976 cpu_share = 0.0 mem_res = 8236 >>contrail-control-nodemgr : << mem_virt = 50620 cpu_share = 0.0 mem_res = 41388 >> } system_mem_usage = << total = 32665116 used = 12114356 free = 636760 buffers = 632284 cached = 19818756 node_type = control-node >> system_cpu_usage = << one_min_avg = 6.71 five_min_avg = 4.0 fifteen_min_avg = 2.62 cpu_share = 0 node_type = control-node >> >> 11/03/2025 01:37:47.643 7faa54897680 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:37:48.267 7faa54897680 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 01:37:48.268 7faa54897680 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 01:37:48.269 7faa54897680 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 01:37:48.269 7faa54897680 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 01:37:48.269 7faa54897680 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-611-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 01:37:48.269 7faa54897680 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 01:37:48.269 7faa54897680 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 01:37:48.269 7faa54897680 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 01:37:48.269 7faa54897680 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:37:48.269 7faa54897680 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-611-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 01:37:48.269 7faa54897680 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:37:48.270 7faa54897680 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:37:48.270 7faa54897680 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-611-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1762133860265154 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 11/03/2025 01:37:48.270 7faa54897680 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:37:52.273 7faa54897680 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 01:37:52.281 7faa54897680 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 11/03/2025 01:37:52.281 7faa54897680 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 01:37:52.281 7faa54897680 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 01:37:52.281 7faa54897680 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-611-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 01:37:52.281 7faa54897680 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 01:37:52.281 7faa54897680 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 11/03/2025 01:37:52.281 7faa54897680 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 11/03/2025 01:37:52.282 7faa54897680 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 11/03/2025 01:37:52.282 7faa54897680 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 11/03/2025 01:37:52.282 7faa54897680 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 11/03/2025 01:37:52.284 7faa54897d60 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001011 11/03/2025 01:37:52.285 7faa54897d60 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 11/03/2025 01:37:52.285 7faa54897680 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 11/03/2025 01:37:52.285 7faa54897680 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 11/03/2025 01:37:52.285 7faa54897680 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:37:52.285 7faa54897680 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 11/03/2025 01:37:52.285 7faa54897680 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 11/03/2025 01:37:52.286 7faa549d6ae0 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 11/03/2025 01:37:52.286 7faa549d6ae0 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 11/03/2025 01:38:04.426 7faa552bc540 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:38:04.647 7faa54897d60 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001290 11/03/2025 01:38:04.648 7faa54897d60 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 11/03/2025 01:38:04.648 7faa55a59f40 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 11/03/2025 01:38:04.648 7faa55a59f40 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 11/03/2025 01:38:04.648 7faa55a59f40 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:38:04.648 7faa55a59f40 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 11/03/2025 01:38:09.948 7faa55a59f40 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:38:23.477 7faa54897180 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:38:37.014 7faa549d6860 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:38:47.607 7faa57fe0600 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-611-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=54791308, partition_space_available_1k=26299176, percentage_partition_space_used=68, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=469236, cpu_share=0.01, mem_res=9996, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17612, cpu_share=0.02, mem_res=11668, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11868, cpu_share=0.0, mem_res=9100, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43344, cpu_share=0.01, mem_res=41380, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=15944688, free=9501088, buffers=646880, cached=7040312, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=12.91, five_min_avg=6.15, fifteen_min_avg=3.44, cpu_share=7.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/03/2025 01:38:50.605 7faa552bc540 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:38:55.567 7faa552bc540 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:39:27.083 7faa54897f40 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:39:47.593 7faa57fe0600 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-611-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=54820544, partition_space_available_1k=26269940, percentage_partition_space_used=68, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=471184, cpu_share=0.01, mem_res=10968, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17944, cpu_share=0.01, mem_res=11988, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11960, cpu_share=0.0, mem_res=9132, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43396, cpu_share=0.01, mem_res=41380, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=16368124, free=8832164, buffers=657724, cached=7274472, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=8.21, five_min_avg=6.09, fifteen_min_avg=3.6, cpu_share=4.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/03/2025 01:40:47.621 7faa57fe0600 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-611-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=54827020, partition_space_available_1k=26263464, percentage_partition_space_used=68, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=471488, cpu_share=0.0, mem_res=11272, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18184, cpu_share=0.01, mem_res=12228, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11960, cpu_share=0.0, mem_res=9132, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43392, cpu_share=0.0, mem_res=41380, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=16835716, free=7751060, buffers=705184, cached=7844020, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.79, five_min_avg=5.67, fifteen_min_avg=3.6, cpu_share=3.12, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/03/2025 01:41:09.526 7faa548975e0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:41:13.183 7faa549d6860 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:41:18.212 7faa549d6860 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:41:47.621 7faa57fe0600 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-611-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=54746516, partition_space_available_1k=26343968, percentage_partition_space_used=68, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=471632, cpu_share=0.01, mem_res=11408, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18376, cpu_share=0.01, mem_res=12420, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11960, cpu_share=0.0, mem_res=9132, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43400, cpu_share=0.01, mem_res=41380, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=16456392, free=7188628, buffers=718180, cached=8769020, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.97, five_min_avg=6.41, fifteen_min_avg=4.01, cpu_share=5.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/03/2025 01:42:47.661 7faa57fe0600 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-611-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=54753420, partition_space_available_1k=26337064, percentage_partition_space_used=68, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=471920, cpu_share=0.0, mem_res=11696, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18588, cpu_share=0.01, mem_res=12632, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11960, cpu_share=0.0, mem_res=9132, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43428, cpu_share=0.0, mem_res=41380, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=16517480, free=7112980, buffers=718184, cached=8782548, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.1, five_min_avg=5.67, fifteen_min_avg=3.9, cpu_share=2.62, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/03/2025 01:43:09.397 7faa549d6ea0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:43:47.652 7faa57fe0600 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-611-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=54767560, partition_space_available_1k=26322924, percentage_partition_space_used=68, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=472504, cpu_share=0.01, mem_res=12216, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18840, cpu_share=0.01, mem_res=12880, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11964, cpu_share=0.0, mem_res=9132, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43428, cpu_share=0.0, mem_res=41380, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=16575056, free=6938636, buffers=720140, cached=8897072, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.87, five_min_avg=5.31, fifteen_min_avg=3.89, cpu_share=4.12, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/03/2025 01:44:47.660 7faa57fe0600 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-611-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=55985720, partition_space_available_1k=25104764, percentage_partition_space_used=69, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=472712, cpu_share=0.0, mem_res=12424, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19080, cpu_share=0.01, mem_res=13116, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11964, cpu_share=0.0, mem_res=9132, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43432, cpu_share=0.0, mem_res=41380, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=16899320, free=5354860, buffers=754912, cached=10122164, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.41, five_min_avg=5.18, fifteen_min_avg=3.94, cpu_share=4.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/03/2025 01:44:54.453 7faa54869f40 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:45:12.996 7faa54897ae0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:45:17.517 7faa55a59f40 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:45:23.569 7faa55a59f40 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:45:47.669 7faa57fe0600 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-611-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=56032312, partition_space_available_1k=25058172, percentage_partition_space_used=69, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=473948, cpu_share=0.01, mem_res=13256, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19356, cpu_share=0.01, mem_res=13356, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11960, cpu_share=0.0, mem_res=9132, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43432, cpu_share=0.01, mem_res=41380, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=18019084, free=4129104, buffers=759880, cached=10221680, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.48, five_min_avg=5.02, fifteen_min_avg=3.95, cpu_share=4.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/03/2025 01:46:47.687 7faa57fe0600 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-611-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=56059872, partition_space_available_1k=25030612, percentage_partition_space_used=69, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=475680, cpu_share=0.02, mem_res=14612, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19984, cpu_share=0.02, mem_res=13880, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11960, cpu_share=0.0, mem_res=9132, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43436, cpu_share=0.0, mem_res=41380, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=18286772, free=3822624, buffers=759948, cached=10260240, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=10.2, five_min_avg=6.34, fifteen_min_avg=4.46, cpu_share=6.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/03/2025 01:47:47.710 7faa57fe0600 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-611-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=56092388, partition_space_available_1k=24998096, percentage_partition_space_used=69, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=477524, cpu_share=0.02, mem_res=15964, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20692, cpu_share=0.02, mem_res=14464, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=12076, cpu_share=0.0, mem_res=9132, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43436, cpu_share=0.0, mem_res=41380, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=18856908, free=3222204, buffers=759984, cached=10290080, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=7.55, five_min_avg=6.41, fifteen_min_avg=4.61, cpu_share=5.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/03/2025 01:48:39.490 7faa548975e0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:48:47.701 7faa57fe0600 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-611-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=56118144, partition_space_available_1k=24972340, percentage_partition_space_used=69, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=479944, cpu_share=0.02, mem_res=17296, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21468, cpu_share=0.02, mem_res=15044, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11964, cpu_share=0.0, mem_res=9132, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43448, cpu_share=0.0, mem_res=41380, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=18431780, free=3603228, buffers=760376, cached=10333372, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=7.39, five_min_avg=6.57, fifteen_min_avg=4.78, cpu_share=4.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/03/2025 01:49:32.683 7faa549d6ea0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:49:36.369 7faa549d6ea0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:49:41.530 7faa548694a0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:49:47.703 7faa57fe0600 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-611-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=56141576, partition_space_available_1k=24948908, percentage_partition_space_used=69, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=481968, cpu_share=0.02, mem_res=18636, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22040, cpu_share=0.01, mem_res=15484, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11964, cpu_share=0.0, mem_res=9132, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43444, cpu_share=0.0, mem_res=41380, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=18478436, free=3531124, buffers=760428, cached=10359088, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=7.37, five_min_avg=6.67, fifteen_min_avg=4.92, cpu_share=4.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/03/2025 01:50:47.720 7faa57fe0600 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-611-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=56191664, partition_space_available_1k=24898820, percentage_partition_space_used=69, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=483548, cpu_share=0.02, mem_res=19476, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22436, cpu_share=0.01, mem_res=15772, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=12232, cpu_share=0.0, mem_res=9132, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43456, cpu_share=0.0, mem_res=41380, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=19145892, free=2818076, buffers=760492, cached=10404604, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.8, five_min_avg=6.35, fifteen_min_avg=4.92, cpu_share=5.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/03/2025 01:51:47.733 7faa57fe0600 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-611-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=56242512, partition_space_available_1k=24847972, percentage_partition_space_used=69, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=484456, cpu_share=0.01, mem_res=20176, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22776, cpu_share=0.01, mem_res=16040, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=11964, cpu_share=0.0, mem_res=9132, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43448, cpu_share=0.01, mem_res=41380, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=18557580, free=3376604, buffers=760504, cached=10433996, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=8.85, five_min_avg=7.64, fifteen_min_avg=5.49, cpu_share=6.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/03/2025 01:52:47.737 7faa57fe0600 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-611-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=56226700, partition_space_available_1k=24863784, percentage_partition_space_used=69, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=485660, cpu_share=0.01, mem_res=20704, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=26112, cpu_share=0.01, mem_res=16428, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=15492, cpu_share=0.0, mem_res=12544, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43456, cpu_share=0.01, mem_res=41380, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=18562052, free=3358348, buffers=760508, cached=10447884, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.93, five_min_avg=6.8, fifteen_min_avg=5.34, cpu_share=3.88, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/03/2025 01:52:50.712 7faa55a59f40 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:53:47.724 7faa57fe0600 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-611-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=56232160, partition_space_available_1k=24858324, percentage_partition_space_used=69, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=486344, cpu_share=0.01, mem_res=21004, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=26620, cpu_share=0.01, mem_res=16852, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16120, cpu_share=0.0, mem_res=13080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43612, cpu_share=0.0, mem_res=41380, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=18889096, free=3020268, buffers=760524, cached=10458884, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.78, five_min_avg=6.23, fifteen_min_avg=5.24, cpu_share=4.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/03/2025 01:54:47.743 7faa57fe0600 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-611-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=56245460, partition_space_available_1k=24845024, percentage_partition_space_used=69, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=486828, cpu_share=0.01, mem_res=21184, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=26816, cpu_share=0.01, mem_res=17004, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16224, cpu_share=0.0, mem_res=13080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43452, cpu_share=0.0, mem_res=41380, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=19487652, free=2408628, buffers=760528, cached=10472140, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.83, five_min_avg=5.52, fifteen_min_avg=5.05, cpu_share=4.62, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/03/2025 01:55:11.768 7faa548699a0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:55:15.712 7faa548699a0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:55:21.340 7faa54869cc0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:55:47.804 7faa57fe0600 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-611-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=56260332, partition_space_available_1k=24830152, percentage_partition_space_used=69, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=487472, cpu_share=0.01, mem_res=21592, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=27132, cpu_share=0.01, mem_res=17268, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16060, cpu_share=0.0, mem_res=13080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43452, cpu_share=0.0, mem_res=41380, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=18702588, free=3161856, buffers=760528, cached=10503888, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=9.53, five_min_avg=6.64, fifteen_min_avg=5.45, cpu_share=6.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/03/2025 01:56:38.916 7faa54897ae0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:56:47.747 7faa57fe0600 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-611-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=56282160, partition_space_available_1k=24808324, percentage_partition_space_used=69, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=488340, cpu_share=0.01, mem_res=22116, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=27572, cpu_share=0.01, mem_res=17600, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16060, cpu_share=0.0, mem_res=13080, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43456, cpu_share=0.0, mem_res=41380, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=18400668, free=3444984, buffers=760528, cached=10522512, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=7.03, five_min_avg=6.35, fifteen_min_avg=5.42, cpu_share=4.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 11/03/2025 01:57:10.784 7faa549d6f40 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 11/03/2025 01:57:24.084 7faa54869b80 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map