05/29/2025 02:09:12.719 7f8eaff25948 [contrail-vrouter-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 05/29/2025 02:09:12.719 7f8eaff25948 [contrail-vrouter-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 05/29/2025 02:09:12.719 7f8eaff25948 [contrail-vrouter-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 05/29/2025 02:09:12.730 7f8ead6f30f0 [contrail-vrouter-nodemgr] [ERROR]: Cannot write http_port 8102 to /tmp/contrail-vrouter-nodemgr.0.http_port 05/29/2025 02:09:12.730 7f8ead6f30f0 [contrail-vrouter-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8102 05/29/2025 02:09:12.730 7f8ead6fba20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvStart] in state[none] 05/29/2025 02:09:12.731 7f8ead6fba20 [contrail-vrouter-nodemgr] [DEBUG]: Add uve in the [ObjectVRouter:NodeStatusUVE] map 05/29/2025 02:09:12.731 7f8ead6fba20 [contrail-vrouter-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 05/29/2025 02:09:12.732 7f8ead6fba20 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 05/29/2025 02:09:12.732 7f8ead6fba20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:09:12.732 7f8ead6fba20 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-1241-1 process_status = [ << module_id = contrail-vrouter-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 05/29/2025 02:09:12.732 7f8ead6fba20 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:09:12.732 7f8ead6fba20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:09:12.732 7f8ead6fba20 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = an-jenkins-deploy-platform-juju-k8s-1241-1:Compute:contrail-vrouter-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8102 start_time = 1748484552731793 collector_name = collector_ip = collector_list = [ 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 05/29/2025 02:09:12.732 7f8ead6fba20 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:09:12.787 7f8eaff25948 [contrail-vrouter-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-vrouter-agent', 'group': 'contrail-vrouter-agent', 'pid': 15636779514542041592716163286556763578661790704874653884640116907766813078808, 'start': '1748484548000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-vrouter-nodemgr', 'group': 'contrail-vrouter-nodemgr', 'pid': 40159509033254184105668274790392547950452310462625824261561751415284427074745, 'start': '1748484490000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 05/29/2025 02:09:12.995 7f8eaff25948 [contrail-vrouter-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-vrouter-nodemgr', _source='an-jenkins-deploy-platform-juju-k8s-1241-1', _node_type='Compute', _instance_id='0', _timestamp=1748484552995735, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1241-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-vrouter-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectVRouter'), _seqnum=0) 05/29/2025 02:09:12.996 7f8eaff25948 [contrail-vrouter-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-vrouter-nodemgr', _source='an-jenkins-deploy-platform-juju-k8s-1241-1', _node_type='Compute', _instance_id='0', _timestamp=1748484552996302, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1241-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-vrouter-agent', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1748484548000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-vrouter-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1748484490000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-05-29 00:52:45.452873", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9256-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectVRouter'), _seqnum=0) 05/29/2025 02:09:13.004 7f8eb614ca20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:09:13.005 7f8eb614ca20 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-1241-1 build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-05-29 00:52:45.452873", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9256-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 2 num_core_per_socket = 2 num_thread_per_core = 1 >> running_package_version = nightly-nightly.el7 installed_package_version = nightly-nightly.el7 >> 05/29/2025 02:09:13.005 7f8eb614ca20 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:09:13.005 7f8eb614ca20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:09:13.005 7f8eb614ca20 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-1241-1 process_status = [ << module_id = contrail-vrouter-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 05/29/2025 02:09:13.006 7f8eb614ca20 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:09:13.006 7f8eb614ca20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:09:13.006 7f8eb614ca20 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-1241-1 deleted = False process_info = [ << process_name = contrail-vrouter-agent process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1748484548000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-vrouter-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1748484490000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-05-29 00:52:45.452873", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9256-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 05/29/2025 02:09:13.006 7f8eb614ca20 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:09:16.037 7f8eaff25948 [contrail-vrouter-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-vrouter-nodemgr', _source='an-jenkins-deploy-platform-juju-k8s-1241-1', _node_type='Compute', _instance_id='0', _timestamp=1748484556037142, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1241-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-vrouter-agent', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1748484548000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-vrouter-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1748484490000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-05-29 00:52:45.452873", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9256-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectVRouter'), _seqnum=0) 05/29/2025 02:09:16.037 7f8eaff25948 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1241-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7089880, partition_space_available_1k=43513952, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=165548, cpu_share=0.0, mem_res=108252, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=80716, cpu_share=0.0, mem_res=39620, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1079232, free=5316524, buffers=225232, cached=1318472, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.82, five_min_avg=0.49, fifteen_min_avg=0.4, cpu_share=0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 05/29/2025 02:09:16.037 7f8eac2c76d8 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:09:16.037 7f8eac2c76d8 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-1241-1 deleted = False process_info = [ << process_name = contrail-vrouter-agent process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1748484548000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-vrouter-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1748484490000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-05-29 00:52:45.452873", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9256-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 05/29/2025 02:09:16.038 7f8eac2c76d8 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:09:16.038 7f8eac2c76d8 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:09:16.038 7f8eac2c76d8 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-1241-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 7089880 partition_space_available_1k = 43513952 percentage_partition_space_used = 14 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-vrouter-agent : << mem_virt = 165548 cpu_share = 0.0 mem_res = 108252 >>contrail-vrouter-nodemgr : << mem_virt = 80716 cpu_share = 0.0 mem_res = 39620 >> } system_mem_usage = << total = 7939460 used = 1079232 free = 5316524 buffers = 225232 cached = 1318472 node_type = vrouter >> system_cpu_usage = << one_min_avg = 0.82 five_min_avg = 0.49 fifteen_min_avg = 0.4 cpu_share = 0 node_type = vrouter >> >> 05/29/2025 02:09:16.038 7f8eac2c76d8 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:09:16.732 7f8eac2a6f60 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/29/2025 02:09:16.734 7f8eac2a6f60 [contrail-vrouter-nodemgr] [INFO]: Session Event: TCP Connected 05/29/2025 02:09:16.734 7f8eac2a6f60 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/29/2025 02:09:16.734 7f8eac2a6f60 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/29/2025 02:09:16.735 7f8eac2a6f60 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-1241-1 process_status = [ << module_id = contrail-vrouter-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/29/2025 02:09:16.735 7f8eac2a6f60 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/29/2025 02:09:16.735 7f8eac2a6f60 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 05/29/2025 02:09:16.735 7f8eac2a6f60 [contrail-vrouter-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 05/29/2025 02:09:16.735 7f8eac2a6f60 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 05/29/2025 02:09:16.735 7f8eac2a6f60 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 05/29/2025 02:09:16.735 7f8eac2a6f60 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 05/29/2025 02:09:16.741 7f8ead6fb780 [contrail-vrouter-nodemgr] [DEBUG]: Extracted sandesh length: 0000001014 05/29/2025 02:09:16.741 7f8ead6fb780 [contrail-vrouter-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 05/29/2025 02:09:16.742 7f8eafd410f0 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 05/29/2025 02:09:16.742 7f8eafd410f0 [contrail-vrouter-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 05/29/2025 02:09:16.742 7f8eafd410f0 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectVRouter:NodeStatusUVE] map 05/29/2025 02:09:16.742 7f8eafd410f0 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 05/29/2025 02:09:16.742 7f8eafd410f0 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 05/29/2025 02:09:16.742 7f8eb13a5c18 [contrail-vrouter-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 05/29/2025 02:09:16.743 7f8eb13a5c18 [contrail-vrouter-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 05/29/2025 02:10:16.031 7f8eaff25948 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1241-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7089932, partition_space_available_1k=43513900, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=167688, cpu_share=0.04, mem_res=110232, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=80744, cpu_share=0.0, mem_res=39568, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1079648, free=5302800, buffers=225284, cached=1331728, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.3, five_min_avg=0.4, fifteen_min_avg=0.37, cpu_share=1.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 05/29/2025 02:11:16.042 7f8eaff25948 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1241-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7089952, partition_space_available_1k=43513880, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=168968, cpu_share=0.04, mem_res=111420, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=80788, cpu_share=0.0, mem_res=39556, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1079156, free=5303240, buffers=225312, cached=1331752, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.11, five_min_avg=0.33, fifteen_min_avg=0.35, cpu_share=1.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 05/29/2025 02:11:43.333 7f8eac2b3198 [contrail-vrouter-nodemgr] [WARNING]: Exception in periodic job: unconverted data remains: Z 05/29/2025 02:11:51.662 7f48e30900c8 [contrail-vrouter-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 05/29/2025 02:11:51.663 7f48e30900c8 [contrail-vrouter-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 05/29/2025 02:11:51.663 7f48e30900c8 [contrail-vrouter-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 05/29/2025 02:11:51.676 7f48e079b0f0 [contrail-vrouter-nodemgr] [ERROR]: Cannot write http_port 8102 to /tmp/contrail-vrouter-nodemgr.0.http_port 05/29/2025 02:11:51.678 7f48e079b0f0 [contrail-vrouter-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8102 05/29/2025 02:11:51.682 7f48e07b1a20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvStart] in state[none] 05/29/2025 02:11:51.686 7f48e07b1a20 [contrail-vrouter-nodemgr] [DEBUG]: Add uve in the [ObjectVRouter:NodeStatusUVE] map 05/29/2025 02:11:51.687 7f48e07b1a20 [contrail-vrouter-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 05/29/2025 02:11:51.687 7f48e07b1a20 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 05/29/2025 02:11:51.688 7f48e07b1a20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:11:51.688 7f48e07b1a20 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-1241-1 process_status = [ << module_id = contrail-vrouter-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 05/29/2025 02:11:51.688 7f48e07b1a20 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:11:51.688 7f48e07b1a20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:11:51.688 7f48e07b1a20 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = an-jenkins-deploy-platform-juju-k8s-1241-1:Compute:contrail-vrouter-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8102 start_time = 1748484711687230 collector_name = collector_ip = collector_list = [ 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 05/29/2025 02:11:51.688 7f48e07b1a20 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:11:51.778 7f48e30900c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-vrouter-agent', 'group': 'contrail-vrouter-agent', 'pid': 75962704031763686730541585796020456223672333595237029807593773808238470252315, 'start': '1748484708000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-vrouter-nodemgr', 'group': 'contrail-vrouter-nodemgr', 'pid': 115451364948435021374887072261054577446351968058261030997752495467031852644801, 'start': '1748484708000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 05/29/2025 02:11:52.039 7f48e30900c8 [contrail-vrouter-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-vrouter-nodemgr', _source='an-jenkins-deploy-platform-juju-k8s-1241-1', _node_type='Compute', _instance_id='0', _timestamp=1748484712038929, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1241-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-vrouter-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectVRouter'), _seqnum=0) 05/29/2025 02:11:52.039 7f48e30900c8 [contrail-vrouter-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-vrouter-nodemgr', _source='an-jenkins-deploy-platform-juju-k8s-1241-1', _node_type='Compute', _instance_id='0', _timestamp=1748484712039476, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1241-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-vrouter-agent', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1748484708000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-vrouter-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1748484708000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-05-29 00:52:45.452873", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9256-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectVRouter'), _seqnum=0) 05/29/2025 02:11:52.042 7f48e07b46d8 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:11:52.043 7f48e07b46d8 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-1241-1 build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-05-29 00:52:45.452873", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9256-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 2 num_core_per_socket = 2 num_thread_per_core = 1 >> running_package_version = nightly-nightly.el7 installed_package_version = nightly-nightly.el7 >> 05/29/2025 02:11:52.043 7f48e07b46d8 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:11:52.043 7f48e07b46d8 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:11:52.043 7f48e07b46d8 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-1241-1 process_status = [ << module_id = contrail-vrouter-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 05/29/2025 02:11:52.043 7f48e07b46d8 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:11:52.043 7f48e07b46d8 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:11:52.048 7f48e07b46d8 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-1241-1 deleted = False process_info = [ << process_name = contrail-vrouter-agent process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1748484708000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-vrouter-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1748484708000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-05-29 00:52:45.452873", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9256-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 05/29/2025 02:11:52.048 7f48e07b46d8 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:11:52.226 7f48e08ddac8 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectVRouter:NodeStatusUVE] map 05/29/2025 02:11:55.099 7f48e30900c8 [contrail-vrouter-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-vrouter-nodemgr', _source='an-jenkins-deploy-platform-juju-k8s-1241-1', _node_type='Compute', _instance_id='0', _timestamp=1748484715098999, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1241-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-vrouter-agent', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1748484708000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-vrouter-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1748484708000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-05-29 00:52:45.452873", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9256-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectVRouter'), _seqnum=0) 05/29/2025 02:11:55.099 7f48e30900c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1241-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7083364, partition_space_available_1k=43520468, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=120336, cpu_share=0.0, mem_res=109868, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51564, cpu_share=0.0, mem_res=39576, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1169876, free=5028404, buffers=227156, cached=1514024, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=1.0, five_min_avg=0.53, fifteen_min_avg=0.41, cpu_share=0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 05/29/2025 02:11:55.099 7f48df3cf438 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:11:55.099 7f48df3cf438 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-1241-1 deleted = False process_info = [ << process_name = contrail-vrouter-agent process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1748484708000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-vrouter-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1748484708000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-05-29 00:52:45.452873", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-9256-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 05/29/2025 02:11:55.099 7f48df3cf438 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:11:55.099 7f48df3cf438 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:11:55.100 7f48df3cf438 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-1241-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 7083364 partition_space_available_1k = 43520468 percentage_partition_space_used = 14 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-vrouter-agent : << mem_virt = 120336 cpu_share = 0.0 mem_res = 109868 >>contrail-vrouter-nodemgr : << mem_virt = 51564 cpu_share = 0.0 mem_res = 39576 >> } system_mem_usage = << total = 7939460 used = 1169876 free = 5028404 buffers = 227156 cached = 1514024 node_type = vrouter >> system_cpu_usage = << one_min_avg = 1.0 five_min_avg = 0.53 fifteen_min_avg = 0.41 cpu_share = 0 node_type = vrouter >> >> 05/29/2025 02:11:55.100 7f48df3cf438 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:11:55.686 7f48e08bcf60 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/29/2025 02:11:55.695 7f48e08bcf60 [contrail-vrouter-nodemgr] [INFO]: Session Event: TCP Connected 05/29/2025 02:11:55.695 7f48e08bcf60 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/29/2025 02:11:55.695 7f48e08bcf60 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/29/2025 02:11:55.695 7f48e08bcf60 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-1241-1 process_status = [ << module_id = contrail-vrouter-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/29/2025 02:11:55.696 7f48e08bcf60 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/29/2025 02:11:55.696 7f48e08bcf60 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 05/29/2025 02:11:55.696 7f48e08bcf60 [contrail-vrouter-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 05/29/2025 02:11:55.696 7f48e08bcf60 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 05/29/2025 02:11:55.696 7f48e08bcf60 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 05/29/2025 02:11:55.696 7f48e08bcf60 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 05/29/2025 02:11:55.701 7f48e07b1780 [contrail-vrouter-nodemgr] [DEBUG]: Extracted sandesh length: 0000001014 05/29/2025 02:11:55.701 7f48e07b1780 [contrail-vrouter-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 05/29/2025 02:11:55.702 7f48e2e290f0 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 05/29/2025 02:11:55.702 7f48e2e290f0 [contrail-vrouter-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 05/29/2025 02:11:55.702 7f48e2e290f0 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectVRouter:NodeStatusUVE] map 05/29/2025 02:11:55.702 7f48e2e290f0 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 05/29/2025 02:11:55.702 7f48e2e290f0 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 05/29/2025 02:11:55.702 7f48df3cf828 [contrail-vrouter-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 05/29/2025 02:11:55.703 7f48df3cf828 [contrail-vrouter-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 05/29/2025 02:12:55.066 7f48e30900c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1241-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7146256, partition_space_available_1k=43457576, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=123732, cpu_share=0.07, mem_res=113272, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51508, cpu_share=0.0, mem_res=39676, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1106088, free=4751876, buffers=229568, cached=1851928, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=1.32, five_min_avg=0.75, fifteen_min_avg=0.5, cpu_share=28.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 05/29/2025 02:13:55.082 7f48e30900c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1241-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7146304, partition_space_available_1k=43457528, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=124888, cpu_share=0.06, mem_res=114196, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51500, cpu_share=0.0, mem_res=39676, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1113012, free=4744812, buffers=229576, cached=1852060, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.48, five_min_avg=0.61, fifteen_min_avg=0.47, cpu_share=1.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 05/29/2025 02:14:55.096 7f48e30900c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1241-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7146336, partition_space_available_1k=43457496, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=126120, cpu_share=0.05, mem_res=115252, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51520, cpu_share=0.0, mem_res=39620, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1113184, free=4744544, buffers=229596, cached=1852136, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.18, five_min_avg=0.5, fifteen_min_avg=0.44, cpu_share=1.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 05/29/2025 02:15:55.112 7f48e30900c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1241-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7145760, partition_space_available_1k=43458072, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=127284, cpu_share=0.04, mem_res=116440, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51524, cpu_share=0.0, mem_res=39600, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1105400, free=4752892, buffers=229612, cached=1851556, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.06, five_min_avg=0.41, fifteen_min_avg=0.41, cpu_share=1.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 05/29/2025 02:16:55.136 7f48e30900c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1241-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7145896, partition_space_available_1k=43457936, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=128680, cpu_share=0.04, mem_res=117760, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51868, cpu_share=0.0, mem_res=39824, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1105056, free=4750456, buffers=229668, cached=1854280, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.44, five_min_avg=0.5, fifteen_min_avg=0.44, cpu_share=5.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 05/29/2025 02:17:25.267 7f48e92b1a20 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectVRouter:NodeStatusUVE] map 05/29/2025 02:17:55.132 7f48e30900c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1241-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7146472, partition_space_available_1k=43457360, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=129184, cpu_share=0.04, mem_res=118288, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51800, cpu_share=0.0, mem_res=39680, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1106868, free=4745272, buffers=229864, cached=1857456, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.16, five_min_avg=0.4, fifteen_min_avg=0.41, cpu_share=2.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 05/29/2025 02:18:55.152 7f48e30900c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1241-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7149156, partition_space_available_1k=43454676, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=142860, cpu_share=0.06, mem_res=123712, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51836, cpu_share=0.0, mem_res=39528, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1159976, free=4670984, buffers=230132, cached=1878368, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.06, five_min_avg=0.33, fifteen_min_avg=0.38, cpu_share=3.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 05/29/2025 02:18:55.152 7f48e30900c8 [contrail-vrouter-nodemgr] [ERROR]: LB stats failure a bytes-like object is required, not 'str' 05/29/2025 02:19:55.169 7f48e30900c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1241-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7429096, partition_space_available_1k=43174736, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=142644, cpu_share=0.07, mem_res=123100, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51836, cpu_share=0.0, mem_res=39600, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1143804, free=4387560, buffers=235088, cached=2173008, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.02, five_min_avg=0.27, fifteen_min_avg=0.35, cpu_share=4.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 05/29/2025 02:19:55.171 7f48e30900c8 [contrail-vrouter-nodemgr] [DEBUG]: Add uve <326d1e60-4852-4d3f-809a-b4210247f133, 1> in the [ObjectLBTable:UveLoadbalancerTrace] map 05/29/2025 02:20:55.174 7f48e30900c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1241-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7431252, partition_space_available_1k=43172580, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=148624, cpu_share=0.05, mem_res=128904, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51836, cpu_share=0.0, mem_res=39616, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1237480, free=4283336, buffers=236104, cached=2182540, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.05, five_min_avg=0.23, fifteen_min_avg=0.34, cpu_share=3.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 05/29/2025 02:21:53.011 7f48df3c8828 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectVRouter:NodeStatusUVE] map 05/29/2025 02:21:55.193 7f48e30900c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1241-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7433284, partition_space_available_1k=43170548, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=149488, cpu_share=0.04, mem_res=129584, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51844, cpu_share=0.0, mem_res=39716, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1259636, free=4258464, buffers=237008, cached=2184352, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=1.13, five_min_avg=0.42, fifteen_min_avg=0.39, cpu_share=4.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 05/29/2025 02:22:55.195 7f48e30900c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1241-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7432200, partition_space_available_1k=43171632, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=150352, cpu_share=0.03, mem_res=130244, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51856, cpu_share=0.0, mem_res=39608, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1245056, free=4272704, buffers=237048, cached=2184652, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.54, five_min_avg=0.38, fifteen_min_avg=0.38, cpu_share=1.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 05/29/2025 02:23:55.213 7f48e30900c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1241-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7431920, partition_space_available_1k=43171912, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=152988, cpu_share=0.04, mem_res=132356, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51856, cpu_share=0.0, mem_res=39684, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1194568, free=4325448, buffers=237100, cached=2182344, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.24, five_min_avg=0.33, fifteen_min_avg=0.35, cpu_share=1.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 05/29/2025 02:24:55.210 7f48e30900c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1241-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7431232, partition_space_available_1k=43172600, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=153852, cpu_share=0.03, mem_res=133148, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51836, cpu_share=0.0, mem_res=39604, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1140324, free=4383044, buffers=237148, cached=2178944, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.09, five_min_avg=0.26, fifteen_min_avg=0.33, cpu_share=1.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 05/29/2025 02:25:55.218 7f48e30900c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1241-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7431296, partition_space_available_1k=43172536, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=154344, cpu_share=0.03, mem_res=133544, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51956, cpu_share=0.0, mem_res=39828, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1137172, free=4386100, buffers=237184, cached=2179004, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.03, five_min_avg=0.21, fifteen_min_avg=0.31, cpu_share=0.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 05/29/2025 02:26:45.380 7f48e08bcf60 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectVRouter:NodeStatusUVE] map 05/29/2025 02:26:55.231 7f48e30900c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1241-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7726492, partition_space_available_1k=42877340, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=155272, cpu_share=0.03, mem_res=134556, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51900, cpu_share=0.0, mem_res=39824, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1174812, free=4030168, buffers=241528, cached=2492952, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.01, five_min_avg=0.17, fifteen_min_avg=0.28, cpu_share=4.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 05/29/2025 02:27:55.247 7f48e30900c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1241-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7726524, partition_space_available_1k=42877308, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=155680, cpu_share=0.03, mem_res=134824, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51944, cpu_share=0.0, mem_res=39804, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1157968, free=4047200, buffers=241580, cached=2492712, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.09, five_min_avg=0.17, fifteen_min_avg=0.27, cpu_share=3.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 05/29/2025 02:28:55.252 7f48e30900c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-1241-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7726388, partition_space_available_1k=42877444, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=155988, cpu_share=0.03, mem_res=134956, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51856, cpu_share=0.0, mem_res=39616, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1136496, free=4068872, buffers=241608, cached=2492484, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.1, five_min_avg=0.16, fifteen_min_avg=0.26, cpu_share=0.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 05/29/2025 02:29:09.573 7f48e08b6f60 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectVRouter:NodeStatusUVE] map