10/30/2025 01:51:02.286 7efe8622b840 [contrail-control-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 10/30/2025 01:51:02.286 7efe8622b840 [contrail-control-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 10/30/2025 01:51:02.286 7efe8622b840 [contrail-control-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 10/30/2025 01:51:02.315 7efe8333a400 [contrail-control-nodemgr] [ERROR]: Cannot write http_port 8101 to /tmp/contrail-control-nodemgr.0.http_port 10/30/2025 01:51:02.317 7efe8333a400 [contrail-control-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8101 10/30/2025 01:51:02.318 7efe8333a7c0 [contrail-control-nodemgr] [INFO]: Processing event[EvStart] in state[none] 10/30/2025 01:51:02.319 7efe8333a7c0 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 01:51:02.319 7efe8333a7c0 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/30/2025 01:51:02.319 7efe8333a7c0 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 10/30/2025 01:51:02.319 7efe8333a7c0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:02.319 7efe8333a7c0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/30/2025 01:51:02.319 7efe8333a7c0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:02.319 7efe8333a7c0 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:02.320 7efe8333a7c0 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1761789062319384 collector_name = collector_ip = collector_list = [ 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 10/30/2025 01:51:02.320 7efe8333a7c0 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:02.560 7efe8622b840 [contrail-control-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-control', 'group': 'contrail-control', 'pid': 38815424466274786991563935344175010272993696943483706216223109534668853116559, 'start': '1761789058000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-dns', 'group': 'contrail-dns', 'pid': 51962099820352187347851724848131852009081371451126947247817826086721589368802, 'start': '1761789058000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-named', 'group': 'contrail-named', 'pid': 108947301780978981034782228684356377033521521177476814697602119354918671198662, 'start': '1761789058000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-control-nodemgr', 'group': 'contrail-control-nodemgr', 'pid': 3490125146954135653591800980782778710786710656758534795998197828109772836562, 'start': '1761789058000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 10/30/2025 01:51:02.725 7efe8622b840 [contrail-control-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-1642-1', _node_type='Control', _instance_id='0', _timestamp=1761789062724929, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-control-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 10/30/2025 01:51:02.725 7efe8622b840 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-1642-1', _node_type='Control', _instance_id='0', _timestamp=1761789062725507, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1761789058000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1761789058000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1761789058000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1761789058000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-10-30 00:56:42.728728", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-12281-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed\n"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 10/30/2025 01:51:02.727 7efe8333a860 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:02.728 7efe8333a860 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 build_info = {"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-10-30 00:56:42.728728", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-12281-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed "}]} system_cpu_info = << num_socket = 1 num_cpu = 4 num_core_per_socket = 4 num_thread_per_core = 1 >> running_package_version = package contrail-lib is not installed installed_package_version = package contrail-lib is not installed >> 10/30/2025 01:51:02.728 7efe8333a860 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:02.728 7efe8333a860 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:02.728 7efe8333a860 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/30/2025 01:51:02.729 7efe8333a860 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:02.729 7efe8333a860 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:02.732 7efe8333a860 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 deleted = False process_info = [ << process_name = contrail-control process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1761789058000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-dns process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1761789058000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-named process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1761789058000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-control-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1761789058000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-10-30 00:56:42.728728", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-12281-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed "}]} >> 10/30/2025 01:51:02.732 7efe8333a860 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:04.499 7efe8333a860 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 01:51:06.321 7efe832a7860 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/30/2025 01:51:06.322 7efe832a7860 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 10/30/2025 01:51:06.322 7efe832a7860 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/30/2025 01:51:06.322 7efe832a7860 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/30/2025 01:51:06.322 7efe832a7860 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/30/2025 01:51:06.322 7efe832a7860 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/30/2025 01:51:06.322 7efe832a7860 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 10/30/2025 01:51:06.322 7efe832a7860 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 10/30/2025 01:51:06.323 7efe832a7860 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 10/30/2025 01:51:06.323 7efe832a7860 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:51:06.323 7efe832a7860 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:51:10.846 7efe8622b840 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-1642-1', _node_type='Control', _instance_id='0', _timestamp=1761789070846195, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1761789058000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1761789058000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1761789058000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1761789058000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "v0+nightly", "build-time" : "2025-10-30 00:56:42.728728", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-12281-1.novalocal", "build-id" : "package contrail", "build-number" : "lib is not installed\n"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 10/30/2025 01:51:10.846 7efe8622b840 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12881340, partition_space_available_1k=68209144, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=549460, cpu_share=0.0, mem_res=4380, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=8140, cpu_share=0.0, mem_res=4020, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=13288, cpu_share=0.0, mem_res=8416, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=57876, cpu_share=0.0, mem_res=45200, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=5614356, free=237248, buffers=368156, cached=10344820, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.63, five_min_avg=2.52, fifteen_min_avg=1.25, cpu_share=0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 10/30/2025 01:51:10.846 7efe8333a860 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:51:10.847 7efe8333a860 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:51:15.158 7efe832a7360 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connection Closed 10/30/2025 01:51:15.159 7efe83fdf540 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 10/30/2025 01:51:15.159 7efe83fdf540 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 10/30/2025 01:51:15.159 7efe83fdf540 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:15.159 7efe83fdf540 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down >>, ] >> 10/30/2025 01:51:15.159 7efe83fdf540 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:15.159 7efe83fdf540 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:15.159 7efe83fdf540 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8101 start_time = 1761789062319384 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/30/2025 01:51:15.160 7efe83fdf540 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:16.293 7efe83fdf540 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 01:51:19.160 7efe8333a860 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/30/2025 01:51:19.161 7efe8333a860 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 10/30/2025 01:51:19.162 7efe8333a860 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/30/2025 01:51:19.162 7efe8333a860 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/30/2025 01:51:19.162 7efe8333a860 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/30/2025 01:51:19.162 7efe8333a860 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/30/2025 01:51:19.162 7efe8333a860 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 10/30/2025 01:51:19.162 7efe8333a860 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 10/30/2025 01:51:19.162 7efe8333a860 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 10/30/2025 01:51:19.162 7efe8333a860 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:51:19.162 7efe8333a860 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:51:19.169 7efe832a7720 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connection Closed 10/30/2025 01:51:19.169 7efe8333a860 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 10/30/2025 01:51:19.170 7efe8333a860 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 10/30/2025 01:51:19.170 7efe8333a860 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:19.170 7efe8333a860 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down >>, ] >> 10/30/2025 01:51:19.170 7efe8333a860 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:19.170 7efe8333a860 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:19.170 7efe8333a860 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 2 pid = 1 http_port = 8101 start_time = 1761789062319384 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/30/2025 01:51:19.170 7efe8333a860 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/30/2025 01:51:23.173 7efe8333a860 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/30/2025 01:51:23.174 7efe8333a860 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 10/30/2025 01:51:23.174 7efe8333a860 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/30/2025 01:51:23.174 7efe8333a860 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/30/2025 01:51:23.174 7efe8333a860 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-1642-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/30/2025 01:51:23.174 7efe8333a860 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/30/2025 01:51:23.174 7efe8333a860 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 10/30/2025 01:51:23.174 7efe8333a860 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 10/30/2025 01:51:23.175 7efe8333a860 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 10/30/2025 01:51:23.175 7efe8333a860 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:51:23.175 7efe8333a860 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/30/2025 01:51:23.235 7efe832a7720 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001013 10/30/2025 01:51:23.236 7efe832a7720 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 10/30/2025 01:51:23.236 7efe8333a860 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 10/30/2025 01:51:23.237 7efe8333a860 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 10/30/2025 01:51:23.237 7efe8333a860 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 01:51:23.237 7efe8333a860 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/30/2025 01:51:23.237 7efe8333a860 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 10/30/2025 01:51:23.237 7efe8333aae0 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 10/30/2025 01:51:23.238 7efe8333aae0 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 10/30/2025 01:51:24.049 7efe8333aae0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 01:51:25.037 7efe832a7720 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001292 10/30/2025 01:51:25.038 7efe832a7720 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 10/30/2025 01:51:25.039 7efe8333ab80 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 10/30/2025 01:51:25.039 7efe8333ab80 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 10/30/2025 01:51:25.039 7efe8333ab80 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 01:51:25.039 7efe8333ab80 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/30/2025 01:51:38.952 7efe8333ae00 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 01:51:46.479 7efe8333ae00 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 01:51:52.368 7efe832a7680 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 01:51:55.128 7efe832a7680 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 01:51:59.600 7efe832a7680 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 01:52:09.799 7efe8622b840 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12940584, partition_space_available_1k=68149900, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=384092, cpu_share=0.01, mem_res=8856, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=15196, cpu_share=0.02, mem_res=10552, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14168, cpu_share=0.0, mem_res=9076, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56904, cpu_share=0.0, mem_res=45092, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7606256, free=363972, buffers=354780, cached=8184424, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.49, five_min_avg=3.51, fifteen_min_avg=1.68, cpu_share=18.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 10/30/2025 01:52:43.509 7efe840a5f40 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 01:52:46.214 7efe840a5f40 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 01:52:50.264 7efe8333aea0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 01:53:10.812 7efe8622b840 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12962720, partition_space_available_1k=68127764, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=386332, cpu_share=0.02, mem_res=11760, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17256, cpu_share=0.02, mem_res=12136, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14228, cpu_share=0.0, mem_res=9076, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56840, cpu_share=0.0, mem_res=44988, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7750088, free=221724, buffers=364696, cached=8173104, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=7.44, five_min_avg=4.54, fifteen_min_avg=2.16, cpu_share=14.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 10/30/2025 01:53:30.190 7efe832a79a0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 01:54:10.815 7efe8622b840 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12971544, partition_space_available_1k=68118940, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=387056, cpu_share=0.0, mem_res=12408, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17448, cpu_share=0.0, mem_res=12532, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14228, cpu_share=0.0, mem_res=9076, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56804, cpu_share=0.0, mem_res=45160, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7697228, free=257916, buffers=364860, cached=8189640, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.87, five_min_avg=4.04, fifteen_min_avg=2.14, cpu_share=9.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 10/30/2025 01:55:10.824 7efe8622b840 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12978568, partition_space_available_1k=68111916, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=387316, cpu_share=0.0, mem_res=12804, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17564, cpu_share=0.0, mem_res=12664, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14228, cpu_share=0.0, mem_res=9076, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56924, cpu_share=0.0, mem_res=45132, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7692644, free=253736, buffers=364928, cached=8198344, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.05, five_min_avg=3.77, fifteen_min_avg=2.17, cpu_share=8.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 10/30/2025 01:56:10.845 7efe8622b840 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12985308, partition_space_available_1k=68105176, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=387516, cpu_share=0.0, mem_res=12936, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17804, cpu_share=0.0, mem_res=12928, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14228, cpu_share=0.0, mem_res=9076, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=57216, cpu_share=0.0, mem_res=45212, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7732776, free=203624, buffers=365056, cached=8207156, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.03, five_min_avg=3.37, fifteen_min_avg=2.13, cpu_share=8.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 10/30/2025 01:57:10.857 7efe8622b840 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12993512, partition_space_available_1k=68096972, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=386448, cpu_share=0.01, mem_res=13596, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17888, cpu_share=0.01, mem_res=12928, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14228, cpu_share=0.0, mem_res=9076, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=57184, cpu_share=0.0, mem_res=45176, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7776168, free=189940, buffers=362212, cached=8180696, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.77, five_min_avg=3.03, fifteen_min_avg=2.09, cpu_share=8.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 10/30/2025 01:57:12.459 7efe8333ae00 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 01:57:15.419 7efe8333ae00 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 01:57:41.100 7efe832a7040 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 01:57:44.074 7efe832a7040 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 01:58:10.859 7efe8622b840 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=13005300, partition_space_available_1k=68085184, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=376508, cpu_share=0.0, mem_res=13580, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17960, cpu_share=0.0, mem_res=12928, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14228, cpu_share=0.0, mem_res=9076, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=57036, cpu_share=0.0, mem_res=45216, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7701572, free=406684, buffers=362412, cached=8039464, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.9, five_min_avg=3.46, fifteen_min_avg=2.3, cpu_share=10.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 10/30/2025 01:59:10.881 7efe8622b840 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=13014888, partition_space_available_1k=68075596, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=376748, cpu_share=0.0, mem_res=13976, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18064, cpu_share=0.01, mem_res=13060, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14228, cpu_share=0.0, mem_res=9076, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=57068, cpu_share=0.0, mem_res=45212, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7755456, free=326032, buffers=364196, cached=8063476, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.25, five_min_avg=3.57, fifteen_min_avg=2.4, cpu_share=10.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 10/30/2025 02:00:10.892 7efe8622b840 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14264260, partition_space_available_1k=66826224, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=306516, cpu_share=0.0, mem_res=14108, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18132, cpu_share=0.0, mem_res=13060, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14228, cpu_share=0.0, mem_res=9076, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56708, cpu_share=0.0, mem_res=45180, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7795124, free=431524, buffers=374220, cached=7916932, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.65, five_min_avg=3.73, fifteen_min_avg=2.53, cpu_share=13.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 10/30/2025 02:01:10.901 7efe8622b840 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14279152, partition_space_available_1k=66811332, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=308196, cpu_share=0.02, mem_res=15288, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18864, cpu_share=0.02, mem_res=13720, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14228, cpu_share=0.0, mem_res=9076, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56744, cpu_share=0.0, mem_res=45048, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7997616, free=209712, buffers=374508, cached=7936564, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.48, five_min_avg=3.56, fifteen_min_avg=2.54, cpu_share=10.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 10/30/2025 02:01:13.179 7efe832a70e0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 02:01:16.897 7efe832a70e0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 02:01:21.651 7efe832a7680 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 02:01:59.860 7efe832a7360 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 02:02:10.903 7efe8622b840 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14312660, partition_space_available_1k=66777824, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=306056, cpu_share=0.02, mem_res=16460, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20096, cpu_share=0.02, mem_res=14644, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14228, cpu_share=0.0, mem_res=9076, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56684, cpu_share=0.0, mem_res=45148, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7944992, free=302504, buffers=373960, cached=7896912, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.16, five_min_avg=4.17, fifteen_min_avg=2.82, cpu_share=12.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 10/30/2025 02:03:09.909 7efe8622b840 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14317112, partition_space_available_1k=66773372, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=306432, cpu_share=0.01, mem_res=16856, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20296, cpu_share=0.01, mem_res=14776, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14228, cpu_share=0.0, mem_res=9076, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56680, cpu_share=0.0, mem_res=45232, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7958452, free=245552, buffers=380472, cached=7933800, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.18, five_min_avg=3.8, fifteen_min_avg=2.78, cpu_share=10.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 10/30/2025 02:04:09.934 7efe8622b840 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14328004, partition_space_available_1k=66762480, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=305488, cpu_share=0.01, mem_res=17780, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20732, cpu_share=0.01, mem_res=15040, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14228, cpu_share=0.0, mem_res=9076, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56588, cpu_share=0.0, mem_res=45068, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7965172, free=274592, buffers=378648, cached=7900252, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.2, five_min_avg=3.39, fifteen_min_avg=2.71, cpu_share=8.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 10/30/2025 02:05:10.934 7efe8622b840 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14331208, partition_space_available_1k=66759276, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=305936, cpu_share=0.0, mem_res=18176, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20904, cpu_share=0.0, mem_res=15304, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14228, cpu_share=0.0, mem_res=9076, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56604, cpu_share=0.0, mem_res=44980, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=8002148, free=229340, buffers=378712, cached=7907632, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.64, five_min_avg=3.43, fifteen_min_avg=2.75, cpu_share=8.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 10/30/2025 02:06:09.953 7efe8622b840 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14347724, partition_space_available_1k=66742760, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=305752, cpu_share=0.02, mem_res=18836, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21636, cpu_share=0.02, mem_res=15568, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14228, cpu_share=0.0, mem_res=9076, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56668, cpu_share=0.0, mem_res=45188, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7839560, free=408264, buffers=377608, cached=7891660, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.89, five_min_avg=3.85, fifteen_min_avg=2.94, cpu_share=10.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 10/30/2025 02:06:21.556 7efe8328eb80 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 02:06:25.073 7efe8333aae0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 02:06:27.619 7efe8333aae0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 02:06:31.538 7efe8333aae0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 02:07:10.971 7efe8622b840 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14699136, partition_space_available_1k=66391348, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=283940, cpu_share=0.0, mem_res=19100, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21736, cpu_share=0.01, mem_res=15832, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14224, cpu_share=0.0, mem_res=9076, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56628, cpu_share=0.0, mem_res=45116, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=8000688, free=373668, buffers=383188, cached=7763132, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.79, five_min_avg=3.69, fifteen_min_avg=2.93, cpu_share=12.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 10/30/2025 02:07:17.207 7efe8333acc0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 02:07:44.185 7efe8333a860 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 02:08:09.988 7efe8622b840 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14715788, partition_space_available_1k=66374696, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=282892, cpu_share=0.01, mem_res=19628, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22080, cpu_share=0.01, mem_res=16096, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14224, cpu_share=0.0, mem_res=9076, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56664, cpu_share=0.0, mem_res=45072, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=8019000, free=350408, buffers=387696, cached=7763744, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.63, five_min_avg=3.68, fifteen_min_avg=2.98, cpu_share=12.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 10/30/2025 02:08:31.654 7efe83fdf540 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 02:08:58.577 7efe8333aae0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 10/30/2025 02:09:09.986 7efe8622b840 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14722980, partition_space_available_1k=66367504, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=282988, cpu_share=0.01, mem_res=19876, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22200, cpu_share=0.01, mem_res=16360, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14224, cpu_share=0.0, mem_res=9076, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56752, cpu_share=0.0, mem_res=45092, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7936228, free=434660, buffers=387272, cached=7762792, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.85, five_min_avg=3.43, fifteen_min_avg=2.94, cpu_share=11.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 10/30/2025 02:10:09.997 7efe8622b840 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-1642-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=14721048, partition_space_available_1k=66369436, percentage_partition_space_used=18, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=283752, cpu_share=0.01, mem_res=20404, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22492, cpu_share=0.01, mem_res=16492, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=14224, cpu_share=0.0, mem_res=9076, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56880, cpu_share=0.0, mem_res=44992, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184208, used=7853372, free=516256, buffers=387860, cached=7763360, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.62, five_min_avg=3.21, fifteen_min_avg=2.89, cpu_share=9.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 10/30/2025 02:10:29.955 7efe8333af40 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map