01/16/2025 02:01:52.926 7fbd1aa54848 [contrail-config-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 01/16/2025 02:01:52.926 7fbd1aa54848 [contrail-config-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 01/16/2025 02:01:52.927 7fbd1aa54848 [contrail-config-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 01/16/2025 02:01:52.937 7fbd17045438 [contrail-config-nodemgr] [ERROR]: Cannot write http_port 8100 to /tmp/contrail-config-nodemgr.0.http_port 01/16/2025 02:01:52.937 7fbd17045438 [contrail-config-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8100 01/16/2025 02:01:52.938 7fbd1704ad68 [contrail-config-nodemgr] [INFO]: Processing event[EvStart] in state[none] 01/16/2025 02:01:52.942 7fbd1704ad68 [contrail-config-nodemgr] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:01:52.942 7fbd1704ad68 [contrail-config-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/16/2025 02:01:52.943 7fbd1704ad68 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 01/16/2025 02:01:52.947 7fbd1704ad68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:01:52.948 7fbd1704ad68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/16/2025 02:01:52.948 7fbd1704ad68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:01:52.948 7fbd1704ad68 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:01:52.948 7fbd1704ad68 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1736992912942881 collector_name = collector_ip = collector_list = [ 10.0.0.58:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 01/16/2025 02:01:52.948 7fbd1704ad68 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:01:53.066 7fbd1aa54848 [contrail-config-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-api', 'group': 'contrail-api', 'pid': 47085717896302322714294685103889960194488397148212093686994944267794078700093, 'start': '1736992910000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-schema', 'group': 'contrail-schema', 'pid': 51158774166438310857622010221013360527780930767689250552012453723040942430680, 'start': '1736992910000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-svc-monitor', 'group': 'contrail-svc-monitor', 'pid': 100060159327407530759578926235912008443509982838238386443318595278917575037343, 'start': '1736992910000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-device-manager', 'group': 'contrail-device-manager', 'pid': 33289703232616146227360878997261232482193646702587775123059478159587275775999, 'start': '1736992910000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-config-nodemgr', 'group': 'contrail-config-nodemgr', 'pid': 30478883916968292848583611890565979386269240965513654490022570309925635418771, 'start': '1736992910000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 01/16/2025 02:01:53.343 7fbd1aa54848 [contrail-config-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-940-1', _node_type='Config', _instance_id='0', _timestamp=1736992913343160, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-config-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 01/16/2025 02:01:53.343 7fbd1aa54848 [contrail-config-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-940-1', _node_type='Config', _instance_id='0', _timestamp=1736992913343831, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1736992910000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-schema', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1736992910000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-svc-monitor', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1736992910000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-device-manager', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1736992910000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1736992910000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-01-16 00:50:10.716677", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7543-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 01/16/2025 02:01:53.349 7fbd20ceea20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:01:53.350 7fbd20ceea20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1 build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-01-16 00:50:10.716677", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7543-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 4 num_core_per_socket = 4 num_thread_per_core = 1 >> running_package_version = nightly-nightly.el7 installed_package_version = nightly-nightly.el7 >> 01/16/2025 02:01:53.350 7fbd20ceea20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:01:53.350 7fbd20ceea20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:01:53.350 7fbd20ceea20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/16/2025 02:01:53.350 7fbd20ceea20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:01:53.350 7fbd20ceea20 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:01:53.351 7fbd20ceea20 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1 deleted = False process_info = [ << process_name = contrail-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1736992910000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-schema process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1736992910000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-svc-monitor process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1736992910000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-device-manager process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1736992910000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1736992910000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-01-16 00:50:10.716677", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7543-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 01/16/2025 02:01:53.351 7fbd20ceea20 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:01:56.942 7fbd1830a198 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 02:01:56.944 7fbd1830a198 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 02:01:56.944 7fbd1830a198 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 02:01:56.944 7fbd1830a198 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 02:01:56.945 7fbd1830a198 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.58:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 02:01:56.945 7fbd1830a198 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 02:01:56.945 7fbd1830a198 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 02:01:56.946 7fbd1830a198 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 02:01:56.946 7fbd1830a198 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:01:56.946 7fbd1830a198 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.58:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 02:01:56.946 7fbd1830a198 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:01:56.946 7fbd1830a198 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:01:56.946 7fbd1830a198 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1736992912942881 collector_name = collector_ip = 10.0.0.58:8086 collector_list = [ 10.0.0.58:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 02:01:56.946 7fbd1830a198 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:00.945 7fbd1830ab70 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 02:02:00.946 7fbd1830ab70 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 02:02:00.946 7fbd1830ab70 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 02:02:00.947 7fbd1830ab70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 02:02:00.947 7fbd1830ab70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.58:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 02:02:00.947 7fbd1830ab70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 02:02:00.947 7fbd1830ab70 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 02:02:00.947 7fbd1830ab70 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 02:02:00.947 7fbd1830ab70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:00.947 7fbd1830ab70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.58:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 02:02:00.948 7fbd1830ab70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:00.948 7fbd1830ab70 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:00.948 7fbd1830ab70 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1736992912942881 collector_name = collector_ip = 10.0.0.58:8086 collector_list = [ 10.0.0.58:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 02:02:00.948 7fbd1830ab70 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:01.510 7fbd1830ab70 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:02:02.472 7fbd1aa54848 [contrail-config-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-nodemgr', _source='cn-jenkins-deploy-platform-juju-k8s-940-1', _node_type='Config', _instance_id='0', _timestamp=1736992922472675, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-api', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1736992910000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-schema', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1736992910000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-svc-monitor', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1736992910000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-device-manager', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1736992910000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1736992910000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-01-16 00:50:10.716677", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7543-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigNode'), _seqnum=0) 01/16/2025 02:02:02.473 7fbd1aa54848 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10138648, partition_space_available_1k=70951836, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=3272, cpu_share=0, mem_res=552, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=3120, cpu_share=0, mem_res=812, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=3308, cpu_share=0, mem_res=628, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=3304, cpu_share=0, mem_res=700, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53068, cpu_share=0, mem_res=38916, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=3338952, free=1889292, buffers=454976, cached=10500984, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.57, five_min_avg=2.03, fifteen_min_avg=0.91, cpu_share=0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/16/2025 02:02:02.473 7fbd16ee6588 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:02.473 7fbd16ee6588 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1 deleted = False process_info = [ << process_name = contrail-api process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1736992910000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-schema process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1736992910000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-svc-monitor process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1736992910000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-device-manager process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1736992910000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1736992910000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-01-16 00:50:10.716677", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7543-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 01/16/2025 02:02:02.473 7fbd16ee6588 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:02.473 7fbd16ee6588 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:02.473 7fbd16ee6588 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 10138648 partition_space_available_1k = 70951836 percentage_partition_space_used = 13 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-api : << mem_virt = 3272 cpu_share = 0 mem_res = 552 >>contrail-schema : << mem_virt = 3120 cpu_share = 0 mem_res = 812 >>contrail-svc-monitor : << mem_virt = 3308 cpu_share = 0 mem_res = 628 >>contrail-device-manager : << mem_virt = 3304 cpu_share = 0 mem_res = 700 >>contrail-config-nodemgr : << mem_virt = 53068 cpu_share = 0 mem_res = 38916 >> } system_mem_usage = << total = 16184204 used = 3338952 free = 1889292 buffers = 454976 cached = 10500984 node_type = config-node >> system_cpu_usage = << one_min_avg = 4.57 five_min_avg = 2.03 fifteen_min_avg = 0.91 cpu_share = 0 node_type = config-node >> >> 01/16/2025 02:02:02.474 7fbd16ee6588 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:04.947 7fbd1a7c04e0 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 02:02:04.948 7fbd1a7c04e0 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 02:02:04.948 7fbd1a7c04e0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 02:02:04.948 7fbd1a7c04e0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 02:02:04.948 7fbd1a7c04e0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.58:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 02:02:04.949 7fbd1a7c04e0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 02:02:04.949 7fbd1a7c04e0 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 02:02:04.949 7fbd1a7c04e0 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 02:02:04.949 7fbd1a7c04e0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:04.949 7fbd1a7c04e0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.58:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 02:02:04.949 7fbd1a7c04e0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:04.949 7fbd1a7c04e0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:04.949 7fbd1a7c04e0 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1736992912942881 collector_name = collector_ip = 10.0.0.58:8086 collector_list = [ 10.0.0.58:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 02:02:04.950 7fbd1a7c04e0 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:08.952 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 02:02:08.959 7fbd1a44d240 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 02:02:08.959 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 02:02:08.959 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 02:02:08.959 7fbd1a44d240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.58:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 02:02:08.959 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 02:02:08.959 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 02:02:08.960 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 02:02:08.960 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:08.960 7fbd1a44d240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.58:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 02:02:08.960 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:08.960 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:08.960 7fbd1a44d240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1736992912942881 collector_name = collector_ip = 10.0.0.58:8086 collector_list = [ 10.0.0.58:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 02:02:08.960 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:12.090 7fbd1a44d240 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:02:12.960 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 02:02:12.961 7fbd1a44d240 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 02:02:12.961 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 02:02:12.961 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 02:02:12.961 7fbd1a44d240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.58:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 02:02:12.961 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 02:02:12.962 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 02:02:12.962 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 02:02:12.962 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:12.962 7fbd1a44d240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.58:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 02:02:12.962 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:12.962 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:12.962 7fbd1a44d240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1736992912942881 collector_name = collector_ip = 10.0.0.58:8086 collector_list = [ 10.0.0.58:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 02:02:12.963 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:16.963 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 02:02:16.967 7fbd1a44d240 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 02:02:16.967 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 02:02:16.967 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 02:02:16.967 7fbd1a44d240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.58:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 02:02:16.967 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 02:02:16.967 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 02:02:16.968 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 02:02:16.968 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:16.968 7fbd1a44d240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.58:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 02:02:16.968 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:16.968 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:16.968 7fbd1a44d240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1736992912942881 collector_name = collector_ip = 10.0.0.58:8086 collector_list = [ 10.0.0.58:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 02:02:16.968 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:20.972 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 02:02:20.973 7fbd1a44d240 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 02:02:20.973 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 02:02:20.974 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 02:02:20.974 7fbd1a44d240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.58:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 02:02:20.974 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 02:02:20.974 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 02:02:20.974 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 02:02:20.975 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:20.975 7fbd1a44d240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.58:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 02:02:20.975 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:20.975 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:20.975 7fbd1a44d240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1736992912942881 collector_name = collector_ip = 10.0.0.58:8086 collector_list = [ 10.0.0.58:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 02:02:20.975 7fbd1a44d240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:24.875 7fbd16edd240 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:02:24.974 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 02:02:24.975 7fbd16edd240 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 02:02:24.975 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 02:02:24.975 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 02:02:24.975 7fbd16edd240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.58:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 02:02:24.975 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 02:02:24.975 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 02:02:24.976 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 02:02:24.976 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:24.976 7fbd16edd240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.58:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 02:02:24.976 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:24.976 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:24.976 7fbd16edd240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1736992912942881 collector_name = collector_ip = 10.0.0.58:8086 collector_list = [ 10.0.0.58:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 02:02:24.976 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:28.979 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 02:02:28.980 7fbd16edd240 [contrail-config-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 02:02:28.980 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 02:02:28.980 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 02:02:28.980 7fbd16edd240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.58:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 02:02:28.980 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 02:02:28.981 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 02:02:28.981 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 02:02:28.981 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:28.981 7fbd16edd240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.58:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 02:02:28.981 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:28.981 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:28.981 7fbd16edd240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1:Config:contrail-config-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8100 start_time = 1736992912942881 collector_name = collector_ip = 10.0.0.58:8086 collector_list = [ 10.0.0.58:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 02:02:28.981 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 02:02:32.982 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 02:02:32.983 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Session Event: TCP Connected 01/16/2025 02:02:32.984 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 02:02:32.984 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 02:02:32.984 7fbd16edd240 [contrail-config-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-k8s-940-1 process_status = [ << module_id = contrail-config-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.58:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 02:02:32.984 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 02:02:32.984 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/16/2025 02:02:32.984 7fbd16edd240 [contrail-config-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 01/16/2025 02:02:32.985 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/16/2025 02:02:32.985 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/16/2025 02:02:32.985 7fbd16edd240 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/16/2025 02:02:32.991 7fbd1830a2e8 [contrail-config-nodemgr] [DEBUG]: Extracted sandesh length: 0000001012 01/16/2025 02:02:32.991 7fbd1830a2e8 [contrail-config-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/16/2025 02:02:32.992 7fbd16eb8eb8 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 01/16/2025 02:02:32.992 7fbd16eb8eb8 [contrail-config-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 01/16/2025 02:02:32.992 7fbd16eb8eb8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:02:32.992 7fbd16eb8eb8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/16/2025 02:02:32.992 7fbd16eb8eb8 [contrail-config-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 01/16/2025 02:02:32.993 7fbd1831c198 [contrail-config-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/16/2025 02:02:32.994 7fbd1831c198 [contrail-config-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/16/2025 02:02:56.596 7fbd1830a2e8 [contrail-config-nodemgr] [DEBUG]: Extracted sandesh length: 0000001292 01/16/2025 02:02:56.596 7fbd1830a2e8 [contrail-config-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/16/2025 02:02:56.603 7fbd16ed18d0 [contrail-config-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 01/16/2025 02:02:56.603 7fbd16ed18d0 [contrail-config-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 01/16/2025 02:02:56.603 7fbd16ed18d0 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:02:56.603 7fbd16ed18d0 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/16/2025 02:02:58.956 7fbd18333ac8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:03:02.446 7fbd1aa54848 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10714476, partition_space_available_1k=70376008, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=96580, cpu_share=2.5, mem_res=90728, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=80980, cpu_share=1.25, mem_res=75716, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84108, cpu_share=1.5, mem_res=78480, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196652, cpu_share=2.5, mem_res=174156, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52856, cpu_share=0.0, mem_res=39292, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6372812, free=252448, buffers=398184, cached=9160760, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=15.12, five_min_avg=5.25, fifteen_min_avg=2.07, cpu_share=22.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/16/2025 02:03:09.005 7fbd1a86b6d8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:04:02.426 7fbd1aa54848 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10735180, partition_space_available_1k=70355304, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=97112, cpu_share=0.25, mem_res=90860, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81588, cpu_share=0.0, mem_res=76376, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84172, cpu_share=0.0, mem_res=78480, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196796, cpu_share=0.0, mem_res=174288, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52960, cpu_share=0.0, mem_res=39276, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6405372, free=267056, buffers=399628, cached=9112148, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=8.98, five_min_avg=5.21, fifteen_min_avg=2.24, cpu_share=12.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/16/2025 02:05:02.430 7fbd1aa54848 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10739532, partition_space_available_1k=70350952, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=97124, cpu_share=0.0, mem_res=90860, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81588, cpu_share=0.0, mem_res=76376, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84172, cpu_share=0.0, mem_res=78480, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196744, cpu_share=0.0, mem_res=174288, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53044, cpu_share=0.0, mem_res=39340, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6464340, free=252580, buffers=400156, cached=9067128, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.3, five_min_avg=4.53, fifteen_min_avg=2.2, cpu_share=9.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/16/2025 02:05:24.282 7fbd16eddac8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:05:27.498 7fbd16ecf978 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:05:55.397 7fbd18def630 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:06:02.452 7fbd1aa54848 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10741036, partition_space_available_1k=70349448, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=97272, cpu_share=0.0, mem_res=90860, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81588, cpu_share=0.0, mem_res=76376, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84172, cpu_share=0.0, mem_res=78480, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196660, cpu_share=0.0, mem_res=174288, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53216, cpu_share=0.0, mem_res=39316, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6428180, free=445500, buffers=403728, cached=8906796, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.88, five_min_avg=4.41, fifteen_min_avg=2.3, cpu_share=12.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/16/2025 02:06:23.989 7fbd18333978 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:06:29.500 7fbd16ee6438 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:06:37.695 7fbd16ee6438 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:06:42.181 7fbd16ee6438 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:06:47.933 7fbd183336d8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:07:03.474 7fbd1aa54848 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10765876, partition_space_available_1k=70324608, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=100824, cpu_share=2.0, mem_res=92444, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82556, cpu_share=0.25, mem_res=76640, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84692, cpu_share=0.25, mem_res=78480, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=197496, cpu_share=0.25, mem_res=174816, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53828, cpu_share=0.0, mem_res=39340, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6555200, free=286148, buffers=405336, cached=8937520, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=6.34, five_min_avg=5.09, fifteen_min_avg=2.68, cpu_share=15.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/16/2025 02:08:02.487 7fbd1aa54848 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10772412, partition_space_available_1k=70318072, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=100984, cpu_share=0.0, mem_res=92444, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82584, cpu_share=0.0, mem_res=76772, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84696, cpu_share=0.0, mem_res=78480, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=197524, cpu_share=0.0, mem_res=174816, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53832, cpu_share=0.0, mem_res=39344, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6571032, free=262068, buffers=405532, cached=8945572, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.54, five_min_avg=4.51, fifteen_min_avg=2.62, cpu_share=9.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/16/2025 02:09:03.489 7fbd1aa54848 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10778100, partition_space_available_1k=70312384, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=100996, cpu_share=0.0, mem_res=92444, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82584, cpu_share=0.0, mem_res=76772, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84696, cpu_share=0.0, mem_res=78480, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=197532, cpu_share=0.0, mem_res=174816, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53896, cpu_share=0.0, mem_res=39496, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6570304, free=255008, buffers=405580, cached=8953312, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.8, five_min_avg=4.04, fifteen_min_avg=2.58, cpu_share=8.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/16/2025 02:10:02.488 7fbd1aa54848 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10783328, partition_space_available_1k=70307156, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=101004, cpu_share=0.0, mem_res=92444, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82584, cpu_share=0.0, mem_res=76772, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84696, cpu_share=0.0, mem_res=78480, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=197540, cpu_share=0.0, mem_res=174816, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53832, cpu_share=0.0, mem_res=39440, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6606296, free=383560, buffers=403248, cached=8791100, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.21, five_min_avg=3.64, fifteen_min_avg=2.53, cpu_share=8.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/16/2025 02:10:04.012 7fbd18dee588 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:10:08.270 7fbd18dee588 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:10:13.413 7fbd18dee588 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:11:02.503 7fbd1aa54848 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10790240, partition_space_available_1k=70300244, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=101012, cpu_share=0.0, mem_res=92444, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82584, cpu_share=0.0, mem_res=76772, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84696, cpu_share=0.0, mem_res=78480, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=197512, cpu_share=0.0, mem_res=174816, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53900, cpu_share=0.0, mem_res=39448, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6633848, free=337676, buffers=404204, cached=8808476, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.34, five_min_avg=3.42, fifteen_min_avg=2.52, cpu_share=11.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/16/2025 02:11:26.855 7fbd16edd390 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:12:02.512 7fbd1aa54848 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10797100, partition_space_available_1k=70293384, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=101224, cpu_share=0.0, mem_res=92444, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82604, cpu_share=0.0, mem_res=76772, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84708, cpu_share=0.0, mem_res=78480, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=197540, cpu_share=0.0, mem_res=174816, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53788, cpu_share=0.0, mem_res=39488, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6617672, free=342656, buffers=404552, cached=8819324, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.59, five_min_avg=3.27, fifteen_min_avg=2.53, cpu_share=9.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/16/2025 02:13:02.530 7fbd1aa54848 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10802984, partition_space_available_1k=70287500, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=101232, cpu_share=0.0, mem_res=92444, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82604, cpu_share=0.0, mem_res=76772, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84708, cpu_share=0.0, mem_res=78480, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=197552, cpu_share=0.0, mem_res=174816, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53716, cpu_share=0.0, mem_res=39452, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6632140, free=321104, buffers=404592, cached=8826368, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.88, five_min_avg=2.96, fifteen_min_avg=2.46, cpu_share=8.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/16/2025 02:14:02.517 7fbd1aa54848 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10808312, partition_space_available_1k=70282172, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=101244, cpu_share=0.0, mem_res=92444, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82604, cpu_share=0.0, mem_res=76772, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84708, cpu_share=0.0, mem_res=78480, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=197560, cpu_share=0.0, mem_res=174816, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53684, cpu_share=0.0, mem_res=39396, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6623376, free=323364, buffers=404600, cached=8832864, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.99, five_min_avg=3.03, fifteen_min_avg=2.52, cpu_share=8.75, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/16/2025 02:14:12.576 7fbd17060e10 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:14:16.329 7fbd17060e10 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:14:21.798 7fbd16eddeb8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:15:02.543 7fbd1aa54848 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10821928, partition_space_available_1k=70268556, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=101256, cpu_share=0.0, mem_res=92444, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82604, cpu_share=0.0, mem_res=76772, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84708, cpu_share=0.0, mem_res=78480, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=197568, cpu_share=0.0, mem_res=174816, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53760, cpu_share=0.0, mem_res=39616, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6648080, free=290716, buffers=404644, cached=8840764, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.93, five_min_avg=3.02, fifteen_min_avg=2.55, cpu_share=9.75, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/16/2025 02:15:59.479 7fbd16ec68d0 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:16:02.548 7fbd1aa54848 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10828268, partition_space_available_1k=70262216, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=101408, cpu_share=0.0, mem_res=92444, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82628, cpu_share=0.0, mem_res=76772, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84732, cpu_share=0.0, mem_res=78480, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=197596, cpu_share=0.0, mem_res=174816, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53896, cpu_share=0.0, mem_res=39728, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6595952, free=329720, buffers=404692, cached=8853840, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.82, five_min_avg=3.45, fifteen_min_avg=2.72, cpu_share=11.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/16/2025 02:17:02.550 7fbd1aa54848 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11929760, partition_space_available_1k=69160724, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=101292, cpu_share=0.0, mem_res=92444, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=82628, cpu_share=0.0, mem_res=76772, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84732, cpu_share=0.0, mem_res=78480, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196164, cpu_share=0.0, mem_res=174816, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53324, cpu_share=0.0, mem_res=39888, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6673676, free=279344, buffers=402480, cached=8828704, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.55, five_min_avg=3.33, fifteen_min_avg=2.72, cpu_share=13.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/16/2025 02:18:02.551 7fbd1aa54848 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11953404, partition_space_available_1k=69137080, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=103460, cpu_share=1.5, mem_res=93632, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83132, cpu_share=0.25, mem_res=77168, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=85164, cpu_share=0.5, mem_res=78744, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196264, cpu_share=0.0, mem_res=175080, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53292, cpu_share=0.0, mem_res=39868, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6816460, free=252876, buffers=403536, cached=8711332, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.38, five_min_avg=3.71, fifteen_min_avg=2.9, cpu_share=12.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/16/2025 02:19:00.560 7fbd16eddeb8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:19:02.558 7fbd1aa54848 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11971408, partition_space_available_1k=69119076, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=107244, cpu_share=2.5, mem_res=94820, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83936, cpu_share=0.25, mem_res=77432, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=85572, cpu_share=0.25, mem_res=78744, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196568, cpu_share=0.25, mem_res=175080, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53232, cpu_share=0.0, mem_res=39772, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6886464, free=274192, buffers=402980, cached=8620568, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.79, five_min_avg=4.35, fifteen_min_avg=3.18, cpu_share=13.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/16/2025 02:19:04.423 7fbd16edd0f0 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:19:09.626 7fbd16ed0390 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:20:02.563 7fbd1aa54848 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11978696, partition_space_available_1k=69111788, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=107176, cpu_share=0.0, mem_res=94820, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83936, cpu_share=0.0, mem_res=77432, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=85572, cpu_share=0.0, mem_res=78744, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196544, cpu_share=0.0, mem_res=175080, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53244, cpu_share=0.0, mem_res=39604, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6893424, free=250580, buffers=415500, cached=8624700, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.09, five_min_avg=4.08, fifteen_min_avg=3.16, cpu_share=11.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/16/2025 02:20:03.506 7fbd16eb8780 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:21:02.558 7fbd1aa54848 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11984920, partition_space_available_1k=69105564, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=107432, cpu_share=0.0, mem_res=94820, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83940, cpu_share=0.0, mem_res=77432, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=85580, cpu_share=0.0, mem_res=78744, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196528, cpu_share=0.0, mem_res=175080, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53360, cpu_share=0.0, mem_res=39624, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6835860, free=300016, buffers=415680, cached=8632648, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.51, five_min_avg=3.64, fifteen_min_avg=3.06, cpu_share=8.75, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/16/2025 02:22:02.556 7fbd1aa54848 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11990892, partition_space_available_1k=69099592, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=107444, cpu_share=0.0, mem_res=94820, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=83944, cpu_share=0.0, mem_res=77432, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=85600, cpu_share=0.0, mem_res=78744, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196592, cpu_share=0.0, mem_res=175080, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53492, cpu_share=0.0, mem_res=39852, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6847548, free=278152, buffers=415924, cached=8642580, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.94, five_min_avg=3.24, fifteen_min_avg=2.95, cpu_share=9.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/16/2025 02:23:02.571 7fbd1aa54848 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12003300, partition_space_available_1k=69087184, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=108604, cpu_share=1.5, mem_res=95084, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84312, cpu_share=0.0, mem_res=77432, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=85924, cpu_share=0.0, mem_res=78744, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196900, cpu_share=0.0, mem_res=175080, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53548, cpu_share=0.0, mem_res=39660, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6691952, free=410280, buffers=416192, cached=8665780, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.84, five_min_avg=3.47, fifteen_min_avg=3.05, cpu_share=11.25, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/16/2025 02:23:21.726 7fbd16ee6828 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:23:25.518 7fbd16ecf978 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:23:30.998 7fbd1baddc18 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:24:02.564 7fbd1aa54848 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12362220, partition_space_available_1k=68728264, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=108376, cpu_share=0.0, mem_res=95084, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84312, cpu_share=0.0, mem_res=77432, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=85924, cpu_share=0.0, mem_res=78744, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196368, cpu_share=0.0, mem_res=175080, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53324, cpu_share=0.0, mem_res=39684, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6823980, free=319496, buffers=420180, cached=8620548, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.18, five_min_avg=3.34, fifteen_min_avg=3.03, cpu_share=11.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/16/2025 02:24:08.238 7fbd181e6eb8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:25:02.585 7fbd1aa54848 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12377116, partition_space_available_1k=68713368, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=108372, cpu_share=0.0, mem_res=95084, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84316, cpu_share=0.0, mem_res=77432, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=85932, cpu_share=0.0, mem_res=78744, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196320, cpu_share=0.0, mem_res=175080, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53256, cpu_share=0.0, mem_res=39928, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6990060, free=253756, buffers=421316, cached=8519072, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.82, five_min_avg=3.22, fifteen_min_avg=3.0, cpu_share=13.0, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/16/2025 02:25:03.881 7fbd1aa82ac8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:25:08.462 7fbd1aa82ac8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:25:37.564 7fbd18309438 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:26:02.567 7fbd1aa54848 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12386380, partition_space_available_1k=68704104, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=108740, cpu_share=0.5, mem_res=95084, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84356, cpu_share=0.0, mem_res=77432, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=85964, cpu_share=0.0, mem_res=78744, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196232, cpu_share=0.0, mem_res=175080, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53084, cpu_share=0.0, mem_res=39748, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6845660, free=364364, buffers=424184, cached=8549996, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.24, five_min_avg=3.47, fifteen_min_avg=3.1, cpu_share=12.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/16/2025 02:26:06.895 7fbd16ecf6d8 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 02:27:02.580 7fbd1aa54848 [contrail-config-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-juju-k8s-940-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12395480, partition_space_available_1k=68695004, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-api': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=108816, cpu_share=0.0, mem_res=95084, _EventManager__key='contrail-api'), 'contrail-schema': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=84372, cpu_share=0.0, mem_res=77432, _EventManager__key='contrail-schema'), 'contrail-svc-monitor': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=85976, cpu_share=0.0, mem_res=78744, _EventManager__key='contrail-svc-monitor'), 'contrail-device-manager': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=196268, cpu_share=0.0, mem_res=175080, _EventManager__key='contrail-device-manager'), 'contrail-config-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53148, cpu_share=0.0, mem_res=39864, _EventManager__key='contrail-config-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16184204, used=6715664, free=497080, buffers=424472, cached=8546988, node_type='config-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.61, five_min_avg=3.18, fifteen_min_avg=3.02, cpu_share=9.5, node_type='config-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigNode') 01/16/2025 02:27:29.008 7fbd16ec6240 [contrail-config-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map