06/23/2025 01:43:31.162 7f2bf0660488 [contrail-control-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 06/23/2025 01:43:31.162 7f2bf0660488 [contrail-control-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 06/23/2025 01:43:31.162 7f2bf0660488 [contrail-control-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 06/23/2025 01:43:31.174 7f2bede06048 [contrail-control-nodemgr] [ERROR]: Cannot write http_port 8101 to /tmp/contrail-control-nodemgr.0.http_port 06/23/2025 01:43:31.175 7f2bede06048 [contrail-control-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8101 06/23/2025 01:43:31.175 7f2bede0a978 [contrail-control-nodemgr] [INFO]: Processing event[EvStart] in state[none] 06/23/2025 01:43:31.176 7f2bede0a978 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectBgpRouter:NodeStatusUVE] map 06/23/2025 01:43:31.177 7f2bede0a978 [contrail-control-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 06/23/2025 01:43:31.177 7f2bede0a978 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 06/23/2025 01:43:31.177 7f2bede0a978 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/23/2025 01:43:31.177 7f2bede0a978 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-548-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 06/23/2025 01:43:31.177 7f2bede0a978 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/23/2025 01:43:31.177 7f2bede0a978 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/23/2025 01:43:31.178 7f2bede0a978 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-548-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1750643011177249 collector_name = collector_ip = collector_list = [ 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 06/23/2025 01:43:31.178 7f2bede0a978 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/23/2025 01:43:31.302 7f2bf0660488 [contrail-control-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-control', 'group': 'contrail-control', 'pid': 103176315218888697884213556063101236391213657884438958626206491376359505775427, 'start': '1750643008000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-dns', 'group': 'contrail-dns', 'pid': 74250810366322395111109694463672147905847157146693719788135680006975193190667, 'start': '1750643008000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-named', 'group': 'contrail-named', 'pid': 87845743874924219033579544477146305894960385374772149489953216711168722212655, 'start': '1750643008000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-control-nodemgr', 'group': 'contrail-control-nodemgr', 'pid': 68723440967619901889110746751833497278164511939264483169663957957897746854940, 'start': '1750643008000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 06/23/2025 01:43:31.569 7f2bf0660488 [contrail-control-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-juju-os-548-1', _node_type='Control', _instance_id='0', _timestamp=1750643011569161, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-548-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-control-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 06/23/2025 01:43:31.569 7f2bf0660488 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-juju-os-548-1', _node_type='Control', _instance_id='0', _timestamp=1750643011569789, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-548-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1750643008000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1750643008000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1750643008000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1750643008000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-06-23 00:41:07.518613", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9661-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 06/23/2025 01:43:31.573 7f2bec9f3240 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/23/2025 01:43:31.574 7f2bec9f3240 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-548-1 build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-06-23 00:41:07.518613", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9661-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 8 num_core_per_socket = 8 num_thread_per_core = 1 >> running_package_version = nightly-nightly.el7 installed_package_version = nightly-nightly.el7 >> 06/23/2025 01:43:31.575 7f2bec9f3240 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/23/2025 01:43:31.575 7f2bec9f3240 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/23/2025 01:43:31.575 7f2bec9f3240 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-548-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 06/23/2025 01:43:31.575 7f2bec9f3240 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/23/2025 01:43:31.575 7f2bec9f3240 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/23/2025 01:43:31.575 7f2bec9f3240 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-548-1 deleted = False process_info = [ << process_name = contrail-control process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1750643008000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-dns process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1750643008000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-named process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1750643008000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-control-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1750643008000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-06-23 00:41:07.518613", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9661-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 06/23/2025 01:43:31.575 7f2bec9f3240 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/23/2025 01:43:34.342 7f2bed581c18 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 06/23/2025 01:43:35.177 7f2bed581588 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/23/2025 01:43:35.179 7f2bed581588 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/23/2025 01:43:35.179 7f2bed581588 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/23/2025 01:43:35.179 7f2bed581588 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/23/2025 01:43:35.179 7f2bed581588 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-548-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/23/2025 01:43:35.179 7f2bed581588 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/23/2025 01:43:35.179 7f2bed581588 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/23/2025 01:43:35.180 7f2bed581588 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/23/2025 01:43:35.180 7f2bed581588 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/23/2025 01:43:35.180 7f2bed581588 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-548-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/23/2025 01:43:35.180 7f2bed581588 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/23/2025 01:43:35.180 7f2bed581588 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/23/2025 01:43:35.180 7f2bed581588 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-548-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1750643011177249 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 06/23/2025 01:43:35.180 7f2bed581588 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/23/2025 01:43:38.780 7f2bf0660488 [contrail-control-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-control-nodemgr', _source='cn-jenkins-deploy-platform-juju-os-548-1', _node_type='Control', _instance_id='0', _timestamp=1750643018780726, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-548-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-control', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1750643008000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-dns', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1750643008000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-named', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1750643008000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-control-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1750643008000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-06-23 00:41:07.518613", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9661-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter'), _seqnum=0) 06/23/2025 01:43:38.781 7f2bf0660488 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-548-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=50859180, partition_space_available_1k=30231304, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=6932, cpu_share=0.0, mem_res=4308, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=8548, cpu_share=0.0, mem_res=3732, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=34020, cpu_share=0.0, mem_res=32092, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51344, cpu_share=0.0, mem_res=39636, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=11819092, free=583540, buffers=843300, cached=19419184, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.27, five_min_avg=3.66, fifteen_min_avg=2.54, cpu_share=0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 06/23/2025 01:43:38.781 7f2bed56f048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/23/2025 01:43:38.781 7f2bed56f048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-548-1 deleted = False process_info = [ << process_name = contrail-control process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1750643008000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-dns process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1750643008000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-named process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1750643008000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-control-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1750643008000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-06-23 00:41:07.518613", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9661-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 06/23/2025 01:43:38.781 7f2bed56f048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/23/2025 01:43:38.781 7f2bed56f048 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/23/2025 01:43:38.782 7f2bed56f048 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-548-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 50859180 partition_space_available_1k = 30231304 percentage_partition_space_used = 63 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-control : << mem_virt = 6932 cpu_share = 0.0 mem_res = 4308 >>contrail-dns : << mem_virt = 8548 cpu_share = 0.0 mem_res = 3732 >>contrail-named : << mem_virt = 34020 cpu_share = 0.0 mem_res = 32092 >>contrail-control-nodemgr : << mem_virt = 51344 cpu_share = 0.0 mem_res = 39636 >> } system_mem_usage = << total = 32665116 used = 11819092 free = 583540 buffers = 843300 cached = 19419184 node_type = control-node >> system_cpu_usage = << one_min_avg = 6.27 five_min_avg = 3.66 fifteen_min_avg = 2.54 cpu_share = 0 node_type = control-node >> >> 06/23/2025 01:43:38.782 7f2bed56f048 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/23/2025 01:43:39.180 7f2bf1ac3ac8 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/23/2025 01:43:39.182 7f2bf1ac3ac8 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/23/2025 01:43:39.182 7f2bf1ac3ac8 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/23/2025 01:43:39.182 7f2bf1ac3ac8 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/23/2025 01:43:39.182 7f2bf1ac3ac8 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-548-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/23/2025 01:43:39.182 7f2bf1ac3ac8 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/23/2025 01:43:39.182 7f2bf1ac3ac8 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/23/2025 01:43:39.183 7f2bf1ac3ac8 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/23/2025 01:43:39.183 7f2bf1ac3ac8 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/23/2025 01:43:39.183 7f2bf1ac3ac8 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-548-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/23/2025 01:43:39.183 7f2bf1ac3ac8 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/23/2025 01:43:39.183 7f2bf1ac3ac8 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/23/2025 01:43:39.183 7f2bf1ac3ac8 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-548-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1750643011177249 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 06/23/2025 01:43:39.183 7f2bf1ac3ac8 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/23/2025 01:43:41.392 7f2bf1ac3ac8 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 06/23/2025 01:43:43.183 7f2bf1ac3ac8 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/23/2025 01:43:43.185 7f2bf1ac3ac8 [contrail-control-nodemgr] [ERROR]: Session Event: TCP Connect Fail 06/23/2025 01:43:43.185 7f2bf1ac3ac8 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/23/2025 01:43:43.185 7f2bf1ac3ac8 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/23/2025 01:43:43.185 7f2bf1ac3ac8 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-548-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/23/2025 01:43:43.185 7f2bf1ac3ac8 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/23/2025 01:43:43.185 7f2bf1ac3ac8 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/23/2025 01:43:43.186 7f2bf1ac3ac8 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/23/2025 01:43:43.186 7f2bf1ac3ac8 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/23/2025 01:43:43.188 7f2bf1ac3ac8 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-548-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/23/2025 01:43:43.188 7f2bf1ac3ac8 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/23/2025 01:43:43.188 7f2bf1ac3ac8 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/23/2025 01:43:43.188 7f2bf1ac3ac8 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-548-1:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1750643011177249 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 06/23/2025 01:43:43.188 7f2bf1ac3ac8 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/23/2025 01:43:47.186 7f2bed5bc240 [contrail-control-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/23/2025 01:43:47.193 7f2bed5bc240 [contrail-control-nodemgr] [INFO]: Session Event: TCP Connected 06/23/2025 01:43:47.193 7f2bed5bc240 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/23/2025 01:43:47.193 7f2bed5bc240 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/23/2025 01:43:47.194 7f2bed5bc240 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-548-1 process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/23/2025 01:43:47.194 7f2bed5bc240 [contrail-control-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/23/2025 01:43:47.194 7f2bed5bc240 [contrail-control-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 06/23/2025 01:43:47.194 7f2bed5bc240 [contrail-control-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 06/23/2025 01:43:47.194 7f2bed5bc240 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 06/23/2025 01:43:47.194 7f2bed5bc240 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 06/23/2025 01:43:47.194 7f2bed5bc240 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 06/23/2025 01:43:47.197 7f2bf0523390 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001011 06/23/2025 01:43:47.198 7f2bf0523390 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 06/23/2025 01:43:47.198 7f2bed583588 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 06/23/2025 01:43:47.198 7f2bed583588 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 06/23/2025 01:43:47.198 7f2bed583588 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 06/23/2025 01:43:47.198 7f2bed583588 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 06/23/2025 01:43:47.199 7f2bed583588 [contrail-control-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 06/23/2025 01:43:47.199 7f2bed5834e0 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 06/23/2025 01:43:47.200 7f2bed5834e0 [contrail-control-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 06/23/2025 01:43:54.084 7f2bed5834e0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 06/23/2025 01:43:58.059 7f2bf0523390 [contrail-control-nodemgr] [DEBUG]: Extracted sandesh length: 0000001290 06/23/2025 01:43:58.063 7f2bf0523390 [contrail-control-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 06/23/2025 01:43:58.064 7f2bee228780 [contrail-control-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 06/23/2025 01:43:58.065 7f2bee228780 [contrail-control-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 06/23/2025 01:43:58.065 7f2bee228780 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 06/23/2025 01:43:58.065 7f2bee228780 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 06/23/2025 01:44:08.768 7f2bf1ad8d68 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 06/23/2025 01:44:25.137 7f2bf57e3f60 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 06/23/2025 01:44:38.741 7f2bf0660488 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-548-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51430208, partition_space_available_1k=29660276, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=7216, cpu_share=0.0, mem_res=4796, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=12036, cpu_share=0.01, mem_res=7472, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=38956, cpu_share=0.0, mem_res=37168, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=41976, cpu_share=0.01, mem_res=39628, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=14948072, free=12360940, buffers=585444, cached=4770660, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=13.7, five_min_avg=6.34, fifteen_min_avg=3.53, cpu_share=9.38, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 06/23/2025 01:44:58.632 7f2bf16fdc18 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 06/23/2025 01:45:38.748 7f2bf0660488 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-548-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51464836, partition_space_available_1k=29625648, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=15048, cpu_share=0.04, mem_res=12052, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16304, cpu_share=0.04, mem_res=11380, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=38940, cpu_share=0.0, mem_res=37168, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42008, cpu_share=0.01, mem_res=39628, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=15048336, free=12136772, buffers=603516, cached=4876492, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=12.72, five_min_avg=7.66, fifteen_min_avg=4.18, cpu_share=7.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 06/23/2025 01:46:38.755 7f2bf0660488 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-548-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51489224, partition_space_available_1k=29601260, percentage_partition_space_used=63, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=16744, cpu_share=0.02, mem_res=13608, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17184, cpu_share=0.02, mem_res=12192, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=39628, cpu_share=0.0, mem_res=37836, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42016, cpu_share=0.01, mem_res=39628, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=15196368, free=12056508, buffers=604204, cached=4808036, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.25, five_min_avg=6.69, fifteen_min_avg=4.06, cpu_share=3.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 06/23/2025 01:47:32.682 7f2bed581e10 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 06/23/2025 01:47:38.253 7f2bf742e0f0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 06/23/2025 01:47:38.764 7f2bf0660488 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-548-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51500476, partition_space_available_1k=29590008, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17176, cpu_share=0.01, mem_res=13916, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17412, cpu_share=0.01, mem_res=12416, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=39628, cpu_share=0.0, mem_res=37836, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42016, cpu_share=0.01, mem_res=39628, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=15294212, free=11829824, buffers=605776, cached=4935304, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.72, five_min_avg=5.88, fifteen_min_avg=3.94, cpu_share=3.12, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 06/23/2025 01:47:43.597 7f2bf16f7ac8 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 06/23/2025 01:48:38.789 7f2bf0660488 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-548-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51506556, partition_space_available_1k=29583928, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17188, cpu_share=0.01, mem_res=14048, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17696, cpu_share=0.01, mem_res=12700, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=39628, cpu_share=0.0, mem_res=37836, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42028, cpu_share=0.01, mem_res=39628, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=15210180, free=11818064, buffers=613248, cached=5023624, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.43, five_min_avg=5.11, fifteen_min_avg=3.8, cpu_share=3.12, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 06/23/2025 01:49:07.325 7f2bed54f0f0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 06/23/2025 01:49:38.807 7f2bf0660488 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-548-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=51517112, partition_space_available_1k=29573372, percentage_partition_space_used=64, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17452, cpu_share=0.01, mem_res=14248, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17892, cpu_share=0.01, mem_res=12888, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=39628, cpu_share=0.0, mem_res=37836, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42024, cpu_share=0.01, mem_res=39628, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=15585728, free=10007304, buffers=660804, cached=6411280, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=7.65, five_min_avg=5.77, fifteen_min_avg=4.09, cpu_share=5.75, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 06/23/2025 01:50:38.789 7f2bf0660488 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-548-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=52628644, partition_space_available_1k=28461840, percentage_partition_space_used=65, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=17600, cpu_share=0.01, mem_res=14396, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18040, cpu_share=0.01, mem_res=13036, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=39628, cpu_share=0.0, mem_res=37836, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42040, cpu_share=0.01, mem_res=39628, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=15464860, free=8817700, buffers=689564, cached=7692992, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.41, five_min_avg=5.51, fifteen_min_avg=4.1, cpu_share=6.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 06/23/2025 01:50:59.781 7f2bed5bc6d8 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 06/23/2025 01:51:38.813 7f2bf0660488 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-548-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=52665932, partition_space_available_1k=28424552, percentage_partition_space_used=65, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18024, cpu_share=0.01, mem_res=14740, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18268, cpu_share=0.01, mem_res=13244, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=39628, cpu_share=0.0, mem_res=37836, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42244, cpu_share=0.01, mem_res=39828, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=16479012, free=7690604, buffers=696208, cached=7799292, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.3, five_min_avg=5.13, fifteen_min_avg=4.06, cpu_share=4.38, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 06/23/2025 01:51:40.278 7f2bedd3a630 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 06/23/2025 01:51:45.585 7f2bedd3a630 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 06/23/2025 01:52:13.212 7f2bed57d390 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 06/23/2025 01:52:38.815 7f2bf0660488 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-548-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=52685888, partition_space_available_1k=28404596, percentage_partition_space_used=65, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19536, cpu_share=0.02, mem_res=15820, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=18604, cpu_share=0.02, mem_res=13496, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=39632, cpu_share=0.0, mem_res=37840, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42260, cpu_share=0.01, mem_res=39840, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=16714268, free=7413404, buffers=696768, cached=7840676, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.01, five_min_avg=4.94, fifteen_min_avg=4.07, cpu_share=5.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 06/23/2025 01:53:38.829 7f2bf0660488 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-548-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=52710892, partition_space_available_1k=28379592, percentage_partition_space_used=65, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=22420, cpu_share=0.03, mem_res=17592, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19300, cpu_share=0.02, mem_res=13988, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=39728, cpu_share=0.0, mem_res=37936, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42260, cpu_share=0.01, mem_res=39840, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=16793188, free=7296172, buffers=696804, cached=7878952, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.16, five_min_avg=5.38, fifteen_min_avg=4.27, cpu_share=5.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 06/23/2025 01:54:36.185 7f2bf03b1b70 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 06/23/2025 01:54:38.861 7f2bf0660488 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-548-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=52765988, partition_space_available_1k=28324496, percentage_partition_space_used=65, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=23632, cpu_share=0.02, mem_res=18352, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19552, cpu_share=0.02, mem_res=14140, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=39736, cpu_share=0.0, mem_res=37944, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42264, cpu_share=0.01, mem_res=39840, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=17463140, free=6577852, buffers=697192, cached=7926932, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.0, five_min_avg=5.48, fifteen_min_avg=4.37, cpu_share=5.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 06/23/2025 01:55:38.829 7f2bf0660488 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-548-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=52709044, partition_space_available_1k=28381440, percentage_partition_space_used=65, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=24388, cpu_share=0.01, mem_res=18996, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=19824, cpu_share=0.01, mem_res=14372, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=39736, cpu_share=0.0, mem_res=37944, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42308, cpu_share=0.01, mem_res=39884, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=17949376, free=6081964, buffers=697204, cached=7936572, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.5, five_min_avg=5.66, fifteen_min_avg=4.52, cpu_share=6.5, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 06/23/2025 01:56:03.587 7f2bed5a4b70 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 06/23/2025 01:56:09.022 7f2bed5a4b70 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 06/23/2025 01:56:14.402 7f2bf06508d0 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 06/23/2025 01:56:38.837 7f2bf0660488 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-548-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=52708376, partition_space_available_1k=28382108, percentage_partition_space_used=65, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=25920, cpu_share=0.02, mem_res=19716, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=20988, cpu_share=0.02, mem_res=14604, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52944, cpu_share=0.0, mem_res=51076, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42308, cpu_share=0.01, mem_res=39884, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=17472292, free=6537420, buffers=697232, cached=7958172, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.18, five_min_avg=5.57, fifteen_min_avg=4.55, cpu_share=5.0, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 06/23/2025 01:57:38.846 7f2bf0660488 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-548-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=52716332, partition_space_available_1k=28374152, percentage_partition_space_used=65, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=26788, cpu_share=0.01, mem_res=20276, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21308, cpu_share=0.02, mem_res=14852, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=57816, cpu_share=0.0, mem_res=55936, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42312, cpu_share=0.01, mem_res=39884, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=17034864, free=6959992, buffers=697252, cached=7973008, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.9, five_min_avg=5.42, fifteen_min_avg=4.57, cpu_share=4.88, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 06/23/2025 01:58:38.889 7f2bf0660488 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-548-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=52724604, partition_space_available_1k=28365880, percentage_partition_space_used=65, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=27788, cpu_share=0.02, mem_res=20884, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21612, cpu_share=0.02, mem_res=15092, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=57872, cpu_share=0.0, mem_res=55984, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42316, cpu_share=0.01, mem_res=39884, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=17699000, free=6284344, buffers=697268, cached=7984504, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.15, five_min_avg=5.38, fifteen_min_avg=4.6, cpu_share=5.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 06/23/2025 01:59:13.419 7f2bee1d8630 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 06/23/2025 01:59:29.139 7f2bee2286d8 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map 06/23/2025 01:59:38.855 7f2bf0660488 [contrail-control-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-os-548-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=52734668, partition_space_available_1k=28355816, percentage_partition_space_used=65, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-control': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=28324, cpu_share=0.01, mem_res=21268, _EventManager__key='contrail-control'), 'contrail-dns': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=21756, cpu_share=0.01, mem_res=15204, _EventManager__key='contrail-dns'), 'contrail-named': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=57876, cpu_share=0.0, mem_res=55988, _EventManager__key='contrail-named'), 'contrail-control-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=42308, cpu_share=0.01, mem_res=39884, _EventManager__key='contrail-control-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=32665116, used=16964560, free=6992880, buffers=697272, cached=8010404, node_type='control-node'), system_cpu_usage=SysCpuInfo(one_min_avg=8.16, five_min_avg=5.94, fifteen_min_avg=4.83, cpu_share=6.25, node_type='control-node'), running_package_version=None, installed_package_version=None, _table='ObjectBgpRouter') 06/23/2025 02:00:22.114 7f2bed5876d8 [contrail-control-nodemgr] [DEBUG]: send sync_uve in the [ObjectBgpRouter:NodeStatusUVE] map