03/31/2025 02:13:50.600 7fa6c24ca788 [contrail-vrouter-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 03/31/2025 02:13:50.600 7fa6c24ca788 [contrail-vrouter-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 03/31/2025 02:13:50.600 7fa6c24ca788 [contrail-vrouter-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 03/31/2025 02:13:50.613 7fa6be9930f0 [contrail-vrouter-nodemgr] [ERROR]: Cannot write http_port 8102 to /tmp/contrail-vrouter-nodemgr.0.http_port 03/31/2025 02:13:50.614 7fa6be9930f0 [contrail-vrouter-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8102 03/31/2025 02:13:50.615 7fa6be99ca20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvStart] in state[none] 03/31/2025 02:13:50.616 7fa6be99ca20 [contrail-vrouter-nodemgr] [DEBUG]: Add uve in the [ObjectVRouter:NodeStatusUVE] map 03/31/2025 02:13:50.616 7fa6be99ca20 [contrail-vrouter-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/31/2025 02:13:50.616 7fa6be99ca20 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 03/31/2025 02:13:50.617 7fa6be99ca20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/31/2025 02:13:50.617 7fa6be99ca20 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-1073-1 process_status = [ << module_id = contrail-vrouter-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/31/2025 02:13:50.617 7fa6be99ca20 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/31/2025 02:13:50.617 7fa6be99ca20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/31/2025 02:13:50.617 7fa6be99ca20 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = an-jenkins-deploy-platform-juju-k8s-1073-1:Compute:contrail-vrouter-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8102 start_time = 1743387230616562 collector_name = collector_ip = collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 03/31/2025 02:13:50.617 7fa6be99ca20 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/31/2025 02:13:50.692 7fa6c24ca788 [contrail-vrouter-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-vrouter-agent', 'group': 'contrail-vrouter-agent', 'pid': 37271573299051160813011540578859693326475235147662250224439386318906655470268, 'start': '1743387227000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-vrouter-nodemgr', 'group': 'contrail-vrouter-nodemgr', 'pid': 41057156659146911781308656174095542089806577215410586606934288101493967030522, 'start': '1743387167000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 03/31/2025 02:13:50.923 7fa6c24ca788 [contrail-vrouter-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-vrouter-nodemgr', _source='an-jenkins-deploy-platform-juju-k8s-1073-1', _node_type='Compute', _instance_id='0', _timestamp=1743387230922946, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1073-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-vrouter-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectVRouter'), _seqnum=0) 03/31/2025 02:13:50.924 7fa6c24ca788 [contrail-vrouter-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-vrouter-nodemgr', _source='an-jenkins-deploy-platform-juju-k8s-1073-1', _node_type='Compute', _instance_id='0', _timestamp=1743387230923938, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1073-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-vrouter-agent', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1743387227000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-vrouter-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1743387167000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-03-31 00:53:57.142496", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8423-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectVRouter'), _seqnum=0) 03/31/2025 02:13:50.927 7fa6c8722a20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/31/2025 02:13:50.928 7fa6c8722a20 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-1073-1 build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-03-31 00:53:57.142496", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8423-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 2 num_core_per_socket = 2 num_thread_per_core = 1 >> running_package_version = nightly-nightly.el7 installed_package_version = nightly-nightly.el7 >> 03/31/2025 02:13:50.928 7fa6c8722a20 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/31/2025 02:13:50.928 7fa6c8722a20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/31/2025 02:13:50.928 7fa6c8722a20 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-1073-1 process_status = [ << module_id = contrail-vrouter-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/31/2025 02:13:50.928 7fa6c8722a20 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/31/2025 02:13:50.929 7fa6c8722a20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/31/2025 02:13:50.929 7fa6c8722a20 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-1073-1 deleted = False process_info = [ << process_name = contrail-vrouter-agent process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1743387227000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-vrouter-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1743387167000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-03-31 00:53:57.142496", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8423-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 03/31/2025 02:13:50.929 7fa6c8722a20 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/31/2025 02:13:53.980 7fa6c24ca788 [contrail-vrouter-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-vrouter-nodemgr', _source='an-jenkins-deploy-platform-juju-k8s-1073-1', _node_type='Compute', _instance_id='0', _timestamp=1743387233980229, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1073-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-vrouter-agent', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1743387227000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-vrouter-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1743387167000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-03-31 00:53:57.142496", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8423-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectVRouter'), _seqnum=0) 03/31/2025 02:13:53.980 7fa6c24ca788 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1073-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6603204, partition_space_available_1k=44000628, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=163624, cpu_share=0, mem_res=108180, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81248, cpu_share=0, mem_res=39084, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939456, used=1097640, free=5316556, buffers=218484, cached=1306776, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=1.15, five_min_avg=0.8, fifteen_min_avg=0.41, cpu_share=0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 03/31/2025 02:13:53.980 7fa6bfeb64e0 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/31/2025 02:13:53.981 7fa6bfeb64e0 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-1073-1 deleted = False process_info = [ << process_name = contrail-vrouter-agent process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1743387227000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-vrouter-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1743387167000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-03-31 00:53:57.142496", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8423-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 03/31/2025 02:13:53.981 7fa6bfeb64e0 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/31/2025 02:13:53.981 7fa6bfeb64e0 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/31/2025 02:13:53.981 7fa6bfeb64e0 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-1073-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 6603204 partition_space_available_1k = 44000628 percentage_partition_space_used = 13 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-vrouter-agent : << mem_virt = 163624 cpu_share = 0 mem_res = 108180 >>contrail-vrouter-nodemgr : << mem_virt = 81248 cpu_share = 0 mem_res = 39084 >> } system_mem_usage = << total = 7939456 used = 1097640 free = 5316556 buffers = 218484 cached = 1306776 node_type = vrouter >> system_cpu_usage = << one_min_avg = 1.15 five_min_avg = 0.8 fifteen_min_avg = 0.41 cpu_share = 0 node_type = vrouter >> >> 03/31/2025 02:13:53.981 7fa6bfeb64e0 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/31/2025 02:13:54.617 7fa6c8722a20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/31/2025 02:13:54.620 7fa6c8722a20 [contrail-vrouter-nodemgr] [INFO]: Session Event: TCP Connected 03/31/2025 02:13:54.620 7fa6c8722a20 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/31/2025 02:13:54.620 7fa6c8722a20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/31/2025 02:13:54.620 7fa6c8722a20 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-1073-1 process_status = [ << module_id = contrail-vrouter-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/31/2025 02:13:54.620 7fa6c8722a20 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/31/2025 02:13:54.621 7fa6c8722a20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/31/2025 02:13:54.621 7fa6c8722a20 [contrail-vrouter-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 03/31/2025 02:13:54.621 7fa6c8722a20 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/31/2025 02:13:54.621 7fa6c8722a20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/31/2025 02:13:54.622 7fa6c8722a20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/31/2025 02:13:54.627 7fa6be99c780 [contrail-vrouter-nodemgr] [DEBUG]: Extracted sandesh length: 0000001014 03/31/2025 02:13:54.628 7fa6be99c780 [contrail-vrouter-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/31/2025 02:13:54.628 7fa6c23120f0 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 03/31/2025 02:13:54.628 7fa6c23120f0 [contrail-vrouter-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 03/31/2025 02:13:54.629 7fa6c23120f0 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectVRouter:NodeStatusUVE] map 03/31/2025 02:13:54.629 7fa6c23120f0 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/31/2025 02:13:54.629 7fa6c23120f0 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 03/31/2025 02:13:54.630 7fa6be9b0390 [contrail-vrouter-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/31/2025 02:13:54.631 7fa6be9b0390 [contrail-vrouter-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/31/2025 02:14:53.954 7fa6c24ca788 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1073-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6603272, partition_space_available_1k=44000560, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=165876, cpu_share=1.0, mem_res=110424, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=81204, cpu_share=0.0, mem_res=39104, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939456, used=1076564, free=5323176, buffers=218532, cached=1321184, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.42, five_min_avg=0.65, fifteen_min_avg=0.38, cpu_share=1.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 03/31/2025 02:15:36.256 7fa6bfe99f60 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_process_state:contrail-vrouter-agent,group:contrail-vrouter-agent,state:PROCESS_STATE_RUNNING 03/31/2025 02:15:36.257 7fa6bfe99f60 [contrail-vrouter-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-vrouter-nodemgr', _source='an-jenkins-deploy-platform-juju-k8s-1073-1', _node_type='Compute', _instance_id='0', _timestamp=1743387336256965, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1073-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-vrouter-agent', process_state='PROCESS_STATE_RUNNING', start_count=2, stop_count=0, exit_count=0, last_start_time='1743387336256913', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-vrouter-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1743387167000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-03-31 00:53:57.142496", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8423-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectVRouter'), _seqnum=0) 03/31/2025 02:15:36.285 7fa6bfe99f60 [contrail-vrouter-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-vrouter-agent', 'group': 'contrail-vrouter-agent', 'pid': 45243815990879207973405415793052805328293592824402409256614056204345369521650, 'start': '1743387332000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-vrouter-nodemgr', 'group': 'contrail-vrouter-nodemgr', 'pid': 41057156659146911781308656174095542089806577215410586606934288101493967030522, 'start': '1743387167000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 03/31/2025 02:15:36.285 7fa6bfe99f60 [contrail-vrouter-nodemgr] [DEBUG]: DBG: update_current_processes: process_state_db='{'default': {'contrail-vrouter-agent': , 'contrail-vrouter-nodemgr': }}' 03/31/2025 02:15:43.892 7f67941ea0c8 [contrail-vrouter-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 03/31/2025 02:15:43.892 7f67941ea0c8 [contrail-vrouter-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 03/31/2025 02:15:43.892 7f67941ea0c8 [contrail-vrouter-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 03/31/2025 02:15:43.919 7f6793f250f0 [contrail-vrouter-nodemgr] [ERROR]: Cannot write http_port 8102 to /tmp/contrail-vrouter-nodemgr.0.http_port 03/31/2025 02:15:43.920 7f6793f250f0 [contrail-vrouter-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8102 03/31/2025 02:15:43.923 7f6793f2ba20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvStart] in state[none] 03/31/2025 02:15:43.924 7f6793f2ba20 [contrail-vrouter-nodemgr] [DEBUG]: Add uve in the [ObjectVRouter:NodeStatusUVE] map 03/31/2025 02:15:43.925 7f6793f2ba20 [contrail-vrouter-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/31/2025 02:15:43.925 7f6793f2ba20 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 03/31/2025 02:15:43.925 7f6793f2ba20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/31/2025 02:15:43.926 7f6793f2ba20 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-1073-1 process_status = [ << module_id = contrail-vrouter-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/31/2025 02:15:43.926 7f6793f2ba20 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/31/2025 02:15:43.926 7f6793f2ba20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/31/2025 02:15:43.926 7f6793f2ba20 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = an-jenkins-deploy-platform-juju-k8s-1073-1:Compute:contrail-vrouter-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8102 start_time = 1743387343925268 collector_name = collector_ip = collector_list = [ 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 03/31/2025 02:15:43.926 7f6793f2ba20 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/31/2025 02:15:44.188 7f67941ea0c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-vrouter-agent', 'group': 'contrail-vrouter-agent', 'pid': 45243815990879207973405415793052805328293592824402409256614056204345369521650, 'start': '1743387332000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-vrouter-nodemgr', 'group': 'contrail-vrouter-nodemgr', 'pid': 96040212909261431951404295056654700225312632254168812709715188089087751109078, 'start': '1743387340000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 03/31/2025 02:15:44.338 7f67941ea0c8 [contrail-vrouter-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-vrouter-nodemgr', _source='an-jenkins-deploy-platform-juju-k8s-1073-1', _node_type='Compute', _instance_id='0', _timestamp=1743387344338504, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1073-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-vrouter-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectVRouter'), _seqnum=0) 03/31/2025 02:15:44.339 7f67941ea0c8 [contrail-vrouter-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-vrouter-nodemgr', _source='an-jenkins-deploy-platform-juju-k8s-1073-1', _node_type='Compute', _instance_id='0', _timestamp=1743387344339066, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1073-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-vrouter-agent', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1743387332000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-vrouter-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1743387340000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-03-31 00:53:57.142496", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8423-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectVRouter'), _seqnum=0) 03/31/2025 02:15:44.342 7f679a3cba20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/31/2025 02:15:44.343 7f679a3cba20 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-1073-1 build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-03-31 00:53:57.142496", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8423-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 2 num_core_per_socket = 2 num_thread_per_core = 1 >> running_package_version = nightly-nightly.el7 installed_package_version = nightly-nightly.el7 >> 03/31/2025 02:15:44.343 7f679a3cba20 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/31/2025 02:15:44.343 7f679a3cba20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/31/2025 02:15:44.344 7f679a3cba20 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-1073-1 process_status = [ << module_id = contrail-vrouter-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/31/2025 02:15:44.344 7f679a3cba20 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/31/2025 02:15:44.344 7f679a3cba20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/31/2025 02:15:44.344 7f679a3cba20 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-1073-1 deleted = False process_info = [ << process_name = contrail-vrouter-agent process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1743387332000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-vrouter-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1743387340000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-03-31 00:53:57.142496", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8423-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 03/31/2025 02:15:44.344 7f679a3cba20 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/31/2025 02:15:47.383 7f67941ea0c8 [contrail-vrouter-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-vrouter-nodemgr', _source='an-jenkins-deploy-platform-juju-k8s-1073-1', _node_type='Compute', _instance_id='0', _timestamp=1743387347383511, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1073-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-vrouter-agent', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1743387332000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-vrouter-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1743387340000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-03-31 00:53:57.142496", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8423-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectVRouter'), _seqnum=0) 03/31/2025 02:15:47.383 7f67941ea0c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1073-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6605176, partition_space_available_1k=43998656, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=118996, cpu_share=0, mem_res=109080, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51380, cpu_share=0, mem_res=39432, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939456, used=1212020, free=5008072, buffers=220688, cached=1498676, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=1.06, five_min_avg=0.75, fifteen_min_avg=0.42, cpu_share=0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 03/31/2025 02:15:47.384 7f6793f25438 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/31/2025 02:15:47.384 7f6793f25438 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-1073-1 deleted = False process_info = [ << process_name = contrail-vrouter-agent process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1743387332000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-vrouter-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1743387340000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-03-31 00:53:57.142496", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-8423-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 03/31/2025 02:15:47.384 7f6793f25438 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/31/2025 02:15:47.384 7f6793f25438 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/31/2025 02:15:47.384 7f6793f25438 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-1073-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 6605176 partition_space_available_1k = 43998656 percentage_partition_space_used = 13 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-vrouter-agent : << mem_virt = 118996 cpu_share = 0 mem_res = 109080 >>contrail-vrouter-nodemgr : << mem_virt = 51380 cpu_share = 0 mem_res = 39432 >> } system_mem_usage = << total = 7939456 used = 1212020 free = 5008072 buffers = 220688 cached = 1498676 node_type = vrouter >> system_cpu_usage = << one_min_avg = 1.06 five_min_avg = 0.75 fifteen_min_avg = 0.42 cpu_share = 0 node_type = vrouter >> >> 03/31/2025 02:15:47.385 7f6793f25438 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/31/2025 02:15:47.925 7f6793f25438 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/31/2025 02:15:47.930 7f6793f25438 [contrail-vrouter-nodemgr] [INFO]: Session Event: TCP Connected 03/31/2025 02:15:47.931 7f6793f25438 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/31/2025 02:15:47.931 7f6793f25438 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/31/2025 02:15:47.931 7f6793f25438 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-1073-1 process_status = [ << module_id = contrail-vrouter-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/31/2025 02:15:47.931 7f6793f25438 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/31/2025 02:15:47.931 7f6793f25438 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/31/2025 02:15:47.932 7f6793f25438 [contrail-vrouter-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 03/31/2025 02:15:47.933 7f6793f25438 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/31/2025 02:15:47.933 7f6793f25438 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/31/2025 02:15:47.933 7f6793f25438 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/31/2025 02:15:47.942 7f6793f2b780 [contrail-vrouter-nodemgr] [DEBUG]: Extracted sandesh length: 0000001014 03/31/2025 02:15:47.943 7f6793f2b780 [contrail-vrouter-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/31/2025 02:15:47.943 7f6793f8f0f0 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 03/31/2025 02:15:47.944 7f6793f8f0f0 [contrail-vrouter-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 03/31/2025 02:15:47.944 7f6793f8f0f0 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectVRouter:NodeStatusUVE] map 03/31/2025 02:15:47.944 7f6793f8f0f0 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/31/2025 02:15:47.945 7f6793f8f0f0 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 03/31/2025 02:15:47.945 7f6795624c18 [contrail-vrouter-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/31/2025 02:15:47.947 7f6795624c18 [contrail-vrouter-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/31/2025 02:16:47.373 7f67941ea0c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1073-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6667800, partition_space_available_1k=43936032, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=124208, cpu_share=2.0, mem_res=113688, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51300, cpu_share=0.0, mem_res=39408, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939456, used=1100400, free=4848884, buffers=221264, cached=1768908, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=2.29, five_min_avg=1.33, fifteen_min_avg=0.65, cpu_share=21.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 03/31/2025 02:17:47.390 7f67941ea0c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1073-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6667840, partition_space_available_1k=43935992, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=125448, cpu_share=1.5, mem_res=114764, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51284, cpu_share=0.0, mem_res=39424, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939456, used=1104528, free=4843788, buffers=221280, cached=1769860, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=1.1, five_min_avg=1.19, fifteen_min_avg=0.65, cpu_share=1.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 03/31/2025 02:18:47.398 7f67941ea0c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1073-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6667256, partition_space_available_1k=43936576, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=126672, cpu_share=1.5, mem_res=115952, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51292, cpu_share=0.0, mem_res=39412, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939456, used=1101588, free=4847356, buffers=221300, cached=1769212, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.69, five_min_avg=1.07, fifteen_min_avg=0.64, cpu_share=1.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 03/31/2025 02:19:47.411 7f67941ea0c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1073-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6667304, partition_space_available_1k=43936528, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=127952, cpu_share=1.5, mem_res=117272, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51316, cpu_share=0.0, mem_res=39424, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939456, used=1096768, free=4852112, buffers=221316, cached=1769260, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.25, five_min_avg=0.88, fifteen_min_avg=0.6, cpu_share=1.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 03/31/2025 02:20:12.912 7f6793f7cb70 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectVRouter:NodeStatusUVE] map 03/31/2025 02:20:47.438 7f67941ea0c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1073-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6667476, partition_space_available_1k=43936356, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=129236, cpu_share=1.5, mem_res=118460, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51620, cpu_share=0.0, mem_res=39552, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939456, used=1101984, free=4843944, buffers=221796, cached=1771732, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.44, five_min_avg=0.81, fifteen_min_avg=0.59, cpu_share=7.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 03/31/2025 02:21:47.437 7f67941ea0c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1073-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6949812, partition_space_available_1k=43654020, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=142548, cpu_share=4.0, mem_res=123152, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51628, cpu_share=0.0, mem_res=39328, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939456, used=1160528, free=4466128, buffers=227060, cached=2085740, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.35, five_min_avg=0.71, fifteen_min_avg=0.57, cpu_share=6.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 03/31/2025 02:21:47.438 7f67941ea0c8 [contrail-vrouter-nodemgr] [ERROR]: LB stats failure a bytes-like object is required, not 'str' 03/31/2025 02:22:47.448 7f67941ea0c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1073-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6950448, partition_space_available_1k=43653384, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=144276, cpu_share=4.0, mem_res=124720, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51596, cpu_share=0.0, mem_res=39340, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939456, used=1176860, free=4448008, buffers=227372, cached=2087216, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.53, five_min_avg=0.66, fifteen_min_avg=0.56, cpu_share=4.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 03/31/2025 02:22:47.449 7f67941ea0c8 [contrail-vrouter-nodemgr] [DEBUG]: Add uve <61d809bd-70df-44ef-b24b-11d765e291b6, 1> in the [ObjectLBTable:UveLoadbalancerTrace] map 03/31/2025 02:23:47.464 7f67941ea0c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1073-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6951768, partition_space_available_1k=43652064, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=149224, cpu_share=3.5, mem_res=129640, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51624, cpu_share=0.0, mem_res=39388, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939456, used=1214504, free=4402904, buffers=228276, cached=2093772, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=1.22, five_min_avg=0.77, fifteen_min_avg=0.59, cpu_share=4.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 03/31/2025 02:24:47.473 7f67941ea0c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1073-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6951956, partition_space_available_1k=43651876, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=149908, cpu_share=2.0, mem_res=129732, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51592, cpu_share=0.0, mem_res=39308, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939456, used=1222968, free=4393832, buffers=228316, cached=2094340, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.45, five_min_avg=0.62, fifteen_min_avg=0.55, cpu_share=2.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 03/31/2025 02:25:47.498 7f67941ea0c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1073-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6952208, partition_space_available_1k=43651624, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=151144, cpu_share=2.0, mem_res=130920, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51724, cpu_share=0.0, mem_res=39424, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939456, used=1223744, free=4392284, buffers=228336, cached=2095092, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.26, five_min_avg=0.54, fifteen_min_avg=0.53, cpu_share=4.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 03/31/2025 02:25:51.555 7f6793d662e8 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectVRouter:NodeStatusUVE] map 03/31/2025 02:26:47.500 7f67941ea0c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1073-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6951548, partition_space_available_1k=43652284, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=154004, cpu_share=2.0, mem_res=133296, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51704, cpu_share=0.0, mem_res=39408, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939456, used=1151712, free=4468208, buffers=229188, cached=2090348, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.43, five_min_avg=0.53, fifteen_min_avg=0.53, cpu_share=4.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 03/31/2025 02:27:47.512 7f67941ea0c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1073-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6951244, partition_space_available_1k=43652588, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=154412, cpu_share=1.5, mem_res=133692, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51708, cpu_share=0.0, mem_res=39324, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939456, used=1139724, free=4480624, buffers=229216, cached=2089892, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.49, five_min_avg=0.54, fifteen_min_avg=0.53, cpu_share=1.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 03/31/2025 02:28:47.520 7f67941ea0c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1073-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6951288, partition_space_available_1k=43652544, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=154748, cpu_share=1.5, mem_res=133956, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51708, cpu_share=0.0, mem_res=39420, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939456, used=1139660, free=4480624, buffers=229236, cached=2089936, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.22, five_min_avg=0.45, fifteen_min_avg=0.5, cpu_share=1.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 03/31/2025 02:29:47.527 7f67941ea0c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1073-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7246020, partition_space_available_1k=43357812, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=155616, cpu_share=2.0, mem_res=134948, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51800, cpu_share=0.0, mem_res=39432, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939456, used=1151936, free=4150348, buffers=234120, cached=2403052, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.25, five_min_avg=0.41, fifteen_min_avg=0.48, cpu_share=3.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 03/31/2025 02:30:15.008 7f6793ab24e0 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectVRouter:NodeStatusUVE] map 03/31/2025 02:30:47.550 7f67941ea0c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1073-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7245896, partition_space_available_1k=43357936, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=156056, cpu_share=1.5, mem_res=135044, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51720, cpu_share=0.0, mem_res=39356, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939456, used=1137892, free=4164992, buffers=234244, cached=2402328, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.7, five_min_avg=0.5, fifteen_min_avg=0.5, cpu_share=4.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 03/31/2025 02:31:45.143 7f679a06e048 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectVRouter:NodeStatusUVE] map