01/13/2025 02:06:37.361 7f64f62251c8 [contrail-vrouter-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 01/13/2025 02:06:37.362 7f64f62251c8 [contrail-vrouter-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 01/13/2025 02:06:37.362 7f64f62251c8 [contrail-vrouter-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 01/13/2025 02:06:37.380 7f64f3896390 [contrail-vrouter-nodemgr] [ERROR]: Cannot write http_port 8102 to /tmp/contrail-vrouter-nodemgr.0.http_port 01/13/2025 02:06:37.380 7f64f3896390 [contrail-vrouter-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8102 01/13/2025 02:06:37.381 7f64f3898cc0 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvStart] in state[none] 01/13/2025 02:06:37.381 7f64f3898cc0 [contrail-vrouter-nodemgr] [DEBUG]: Add uve in the [ObjectVRouter:NodeStatusUVE] map 01/13/2025 02:06:37.382 7f64f3898cc0 [contrail-vrouter-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/13/2025 02:06:37.382 7f64f3898cc0 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 01/13/2025 02:06:37.382 7f64f3898cc0 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:06:37.383 7f64f3898cc0 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-917-1 process_status = [ << module_id = contrail-vrouter-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/13/2025 02:06:37.383 7f64f3898cc0 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:06:37.383 7f64f3898cc0 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:06:37.383 7f64f3898cc0 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = an-jenkins-deploy-platform-juju-k8s-917-1:Compute:contrail-vrouter-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8102 start_time = 1736733997382519 collector_name = collector_ip = collector_list = [ 10.0.0.24:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 01/13/2025 02:06:37.383 7f64f3898cc0 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:06:37.467 7f64f62251c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-vrouter-agent', 'group': 'contrail-vrouter-agent', 'pid': 11204336971669904520187582396265740410632329330882700356816279983623811965026, 'start': '1736733993000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-vrouter-nodemgr', 'group': 'contrail-vrouter-nodemgr', 'pid': 1505903561583156396167461598140417366362118148727315207962205586432261450453, 'start': '1736733934000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 01/13/2025 02:06:37.687 7f64f62251c8 [contrail-vrouter-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-vrouter-nodemgr', _source='an-jenkins-deploy-platform-juju-k8s-917-1', _node_type='Compute', _instance_id='0', _timestamp=1736733997687477, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-917-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-vrouter-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectVRouter'), _seqnum=0) 01/13/2025 02:06:37.688 7f64f62251c8 [contrail-vrouter-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-vrouter-nodemgr', _source='an-jenkins-deploy-platform-juju-k8s-917-1', _node_type='Compute', _instance_id='0', _timestamp=1736733997688179, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-917-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-vrouter-agent', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1736733993000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-vrouter-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1736733934000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-01-13 00:51:40.614021", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7417-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectVRouter'), _seqnum=0) 01/13/2025 02:06:37.691 7f64fc3c2a20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:06:37.692 7f64fc3c2a20 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-917-1 build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-01-13 00:51:40.614021", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7417-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 2 num_core_per_socket = 2 num_thread_per_core = 1 >> running_package_version = nightly-nightly.el7 installed_package_version = nightly-nightly.el7 >> 01/13/2025 02:06:37.692 7f64fc3c2a20 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:06:37.692 7f64fc3c2a20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:06:37.692 7f64fc3c2a20 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-917-1 process_status = [ << module_id = contrail-vrouter-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/13/2025 02:06:37.693 7f64fc3c2a20 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:06:37.693 7f64fc3c2a20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:06:37.693 7f64fc3c2a20 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-917-1 deleted = False process_info = [ << process_name = contrail-vrouter-agent process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1736733993000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-vrouter-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1736733934000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-01-13 00:51:40.614021", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7417-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 01/13/2025 02:06:37.693 7f64fc3c2a20 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:06:40.716 7f64f62251c8 [contrail-vrouter-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-vrouter-nodemgr', _source='an-jenkins-deploy-platform-juju-k8s-917-1', _node_type='Compute', _instance_id='0', _timestamp=1736734000716471, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-917-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-vrouter-agent', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1736733993000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-vrouter-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1736733934000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-01-13 00:51:40.614021", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7417-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectVRouter'), _seqnum=0) 01/13/2025 02:06:40.716 7f64f62251c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-917-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6747276, partition_space_available_1k=43856556, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=165012, cpu_share=0, mem_res=107884, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=79948, cpu_share=0, mem_res=39052, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1156748, free=5089228, buffers=227732, cached=1465752, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=1.86, five_min_avg=1.03, fifteen_min_avg=0.55, cpu_share=0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 01/13/2025 02:06:40.717 7f64fc47a048 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:06:40.717 7f64fc47a048 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-917-1 deleted = False process_info = [ << process_name = contrail-vrouter-agent process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1736733993000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-vrouter-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1736733934000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-01-13 00:51:40.614021", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7417-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 01/13/2025 02:06:40.717 7f64fc47a048 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:06:40.717 7f64fc47a048 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:06:40.717 7f64fc47a048 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-917-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 6747276 partition_space_available_1k = 43856556 percentage_partition_space_used = 13 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-vrouter-agent : << mem_virt = 165012 cpu_share = 0 mem_res = 107884 >>contrail-vrouter-nodemgr : << mem_virt = 79948 cpu_share = 0 mem_res = 39052 >> } system_mem_usage = << total = 7939460 used = 1156748 free = 5089228 buffers = 227732 cached = 1465752 node_type = vrouter >> system_cpu_usage = << one_min_avg = 1.86 five_min_avg = 1.03 fifteen_min_avg = 0.55 cpu_share = 0 node_type = vrouter >> >> 01/13/2025 02:06:40.717 7f64fc47a048 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:06:41.382 7f64fc47a048 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/13/2025 02:06:41.385 7f64fc47a048 [contrail-vrouter-nodemgr] [INFO]: Session Event: TCP Connected 01/13/2025 02:06:41.385 7f64fc47a048 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/13/2025 02:06:41.385 7f64fc47a048 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/13/2025 02:06:41.385 7f64fc47a048 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-917-1 process_status = [ << module_id = contrail-vrouter-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.24:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/13/2025 02:06:41.385 7f64fc47a048 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/13/2025 02:06:41.385 7f64fc47a048 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/13/2025 02:06:41.385 7f64fc47a048 [contrail-vrouter-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 01/13/2025 02:06:41.386 7f64fc47a048 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/13/2025 02:06:41.386 7f64fc47a048 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/13/2025 02:06:41.386 7f64fc47a048 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/13/2025 02:06:41.390 7f64f7370f60 [contrail-vrouter-nodemgr] [DEBUG]: Extracted sandesh length: 0000001013 01/13/2025 02:06:41.391 7f64f7370f60 [contrail-vrouter-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/13/2025 02:06:41.391 7f64f5fbdf60 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 01/13/2025 02:06:41.391 7f64f5fbdf60 [contrail-vrouter-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 01/13/2025 02:06:41.392 7f64f5fbdf60 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectVRouter:NodeStatusUVE] map 01/13/2025 02:06:41.392 7f64f5fbdf60 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/13/2025 02:06:41.392 7f64f5fbdf60 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 01/13/2025 02:06:41.392 7f64f24e0ac8 [contrail-vrouter-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/13/2025 02:06:41.393 7f64f24e0ac8 [contrail-vrouter-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/13/2025 02:07:40.725 7f64f62251c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-917-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6747356, partition_space_available_1k=43856476, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=167352, cpu_share=1.0, mem_res=109864, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=79924, cpu_share=0.0, mem_res=39064, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1143072, free=5094132, buffers=227812, cached=1474444, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.68, five_min_avg=0.84, fifteen_min_avg=0.51, cpu_share=1.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 01/13/2025 02:08:40.739 7f64f62251c8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-917-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6747476, partition_space_available_1k=43856356, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=168776, cpu_share=1.0, mem_res=111316, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=79944, cpu_share=0.0, mem_res=39036, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1141588, free=4883260, buffers=229500, cached=1685112, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.39, five_min_avg=0.73, fifteen_min_avg=0.49, cpu_share=7.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 01/13/2025 02:09:10.473 7f8bd73cabc8 [contrail-vrouter-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 01/13/2025 02:09:10.473 7f8bd73cabc8 [contrail-vrouter-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 01/13/2025 02:09:10.473 7f8bd73cabc8 [contrail-vrouter-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 01/13/2025 02:09:10.487 7f8bd4d4a390 [contrail-vrouter-nodemgr] [ERROR]: Cannot write http_port 8102 to /tmp/contrail-vrouter-nodemgr.0.http_port 01/13/2025 02:09:10.488 7f8bd4d4a390 [contrail-vrouter-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8102 01/13/2025 02:09:10.489 7f8bd4d4ccc0 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvStart] in state[none] 01/13/2025 02:09:10.492 7f8bd4d4ccc0 [contrail-vrouter-nodemgr] [DEBUG]: Add uve in the [ObjectVRouter:NodeStatusUVE] map 01/13/2025 02:09:10.494 7f8bd4d4ccc0 [contrail-vrouter-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/13/2025 02:09:10.495 7f8bd4d4ccc0 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 01/13/2025 02:09:10.495 7f8bd4d4ccc0 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:09:10.495 7f8bd4d4ccc0 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-917-1 process_status = [ << module_id = contrail-vrouter-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/13/2025 02:09:10.495 7f8bd4d4ccc0 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:09:10.495 7f8bd4d4ccc0 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:09:10.495 7f8bd4d4ccc0 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = an-jenkins-deploy-platform-juju-k8s-917-1:Compute:contrail-vrouter-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8102 start_time = 1736734150493237 collector_name = collector_ip = collector_list = [ 10.0.0.24:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 01/13/2025 02:09:10.495 7f8bd4d4ccc0 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:09:10.804 7f8bd73cabc8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-vrouter-agent', 'group': 'contrail-vrouter-agent', 'pid': 75950831349901699452604339014920509624156361529721339512910266726840639875367, 'start': '1736734139000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-vrouter-nodemgr', 'group': 'contrail-vrouter-nodemgr', 'pid': 18317006259622218178021753633157297567342382542919431481865527054421155059643, 'start': '1736734146000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 01/13/2025 02:09:11.053 7f8bd73cabc8 [contrail-vrouter-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-vrouter-nodemgr', _source='an-jenkins-deploy-platform-juju-k8s-917-1', _node_type='Compute', _instance_id='0', _timestamp=1736734151053542, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-917-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-vrouter-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectVRouter'), _seqnum=0) 01/13/2025 02:09:11.054 7f8bd73cabc8 [contrail-vrouter-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-vrouter-nodemgr', _source='an-jenkins-deploy-platform-juju-k8s-917-1', _node_type='Compute', _instance_id='0', _timestamp=1736734151054389, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-917-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-vrouter-agent', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1736734139000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-vrouter-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1736734146000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-01-13 00:51:40.614021", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7417-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectVRouter'), _seqnum=0) 01/13/2025 02:09:11.062 7f8bdd61fa20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:09:11.065 7f8bdd61fa20 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-917-1 build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-01-13 00:51:40.614021", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7417-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 2 num_core_per_socket = 2 num_thread_per_core = 1 >> running_package_version = nightly-nightly.el7 installed_package_version = nightly-nightly.el7 >> 01/13/2025 02:09:11.065 7f8bdd61fa20 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:09:11.065 7f8bdd61fa20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:09:11.066 7f8bdd61fa20 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-917-1 process_status = [ << module_id = contrail-vrouter-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/13/2025 02:09:11.068 7f8bdd61fa20 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:09:11.068 7f8bdd61fa20 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:09:11.068 7f8bdd61fa20 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-917-1 deleted = False process_info = [ << process_name = contrail-vrouter-agent process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1736734139000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-vrouter-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1736734146000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-01-13 00:51:40.614021", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7417-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 01/13/2025 02:09:11.068 7f8bdd61fa20 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:09:14.096 7f8bd73cabc8 [contrail-vrouter-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-vrouter-nodemgr', _source='an-jenkins-deploy-platform-juju-k8s-917-1', _node_type='Compute', _instance_id='0', _timestamp=1736734154096852, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-917-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-vrouter-agent', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1736734139000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-vrouter-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1736734146000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-01-13 00:51:40.614021", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7417-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectVRouter'), _seqnum=0) 01/13/2025 02:09:14.097 7f8bd73cabc8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-917-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6741088, partition_space_available_1k=43862744, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=118876, cpu_share=0, mem_res=108592, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51128, cpu_share=0, mem_res=39280, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1279692, free=4636816, buffers=230844, cached=1792108, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.73, five_min_avg=0.76, fifteen_min_avg=0.51, cpu_share=0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 01/13/2025 02:09:14.097 7f8bd4d60780 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:09:14.097 7f8bd4d60780 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-917-1 deleted = False process_info = [ << process_name = contrail-vrouter-agent process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1736734139000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-vrouter-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1736734146000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-01-13 00:51:40.614021", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7417-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 01/13/2025 02:09:14.098 7f8bd4d60780 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:09:14.098 7f8bd4d60780 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:09:14.098 7f8bd4d60780 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-917-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 6741088 partition_space_available_1k = 43862744 percentage_partition_space_used = 13 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-vrouter-agent : << mem_virt = 118876 cpu_share = 0 mem_res = 108592 >>contrail-vrouter-nodemgr : << mem_virt = 51128 cpu_share = 0 mem_res = 39280 >> } system_mem_usage = << total = 7939460 used = 1279692 free = 4636816 buffers = 230844 cached = 1792108 node_type = vrouter >> system_cpu_usage = << one_min_avg = 0.73 five_min_avg = 0.76 fifteen_min_avg = 0.51 cpu_share = 0 node_type = vrouter >> >> 01/13/2025 02:09:14.098 7f8bd4d60780 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:09:14.492 7f8bd71e1438 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/13/2025 02:09:14.495 7f8bd71e1438 [contrail-vrouter-nodemgr] [INFO]: Session Event: TCP Connected 01/13/2025 02:09:14.496 7f8bd71e1438 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/13/2025 02:09:14.496 7f8bd71e1438 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/13/2025 02:09:14.496 7f8bd71e1438 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-917-1 process_status = [ << module_id = contrail-vrouter-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.24:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/13/2025 02:09:14.496 7f8bd71e1438 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/13/2025 02:09:14.496 7f8bd71e1438 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/13/2025 02:09:14.496 7f8bd71e1438 [contrail-vrouter-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 01/13/2025 02:09:14.497 7f8bd71e1438 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/13/2025 02:09:14.497 7f8bd71e1438 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/13/2025 02:09:14.497 7f8bd71e1438 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/13/2025 02:09:14.504 7f8bd85cdf60 [contrail-vrouter-nodemgr] [DEBUG]: Extracted sandesh length: 0000001013 01/13/2025 02:09:14.505 7f8bd85cdf60 [contrail-vrouter-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/13/2025 02:09:14.506 7f8bd721bf60 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 01/13/2025 02:09:14.506 7f8bd721bf60 [contrail-vrouter-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 01/13/2025 02:09:14.506 7f8bd721bf60 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectVRouter:NodeStatusUVE] map 01/13/2025 02:09:14.506 7f8bd721bf60 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/13/2025 02:09:14.507 7f8bd721bf60 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 01/13/2025 02:09:14.507 7f8bd44f9780 [contrail-vrouter-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/13/2025 02:09:14.508 7f8bd44f9780 [contrail-vrouter-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/13/2025 02:10:14.091 7f8bd73cabc8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-917-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6747976, partition_space_available_1k=43855856, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=120688, cpu_share=1.0, mem_res=110440, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51144, cpu_share=0.0, mem_res=39264, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1145760, free=4701840, buffers=230904, cached=1860956, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.67, five_min_avg=0.76, fifteen_min_avg=0.53, cpu_share=17.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 01/13/2025 02:11:14.110 7f8bd73cabc8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-917-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6803056, partition_space_available_1k=43800776, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=124392, cpu_share=1.0, mem_res=113712, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51136, cpu_share=0.0, mem_res=39340, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1160648, free=4620340, buffers=231060, cached=1927412, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.3, five_min_avg=0.63, fifteen_min_avg=0.5, cpu_share=1.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 01/13/2025 02:12:14.116 7f8bd73cabc8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-917-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6803076, partition_space_available_1k=43800756, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=125540, cpu_share=1.0, mem_res=114772, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51140, cpu_share=0.0, mem_res=39256, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1100272, free=4679056, buffers=231096, cached=1929036, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.2, five_min_avg=0.55, fifteen_min_avg=0.48, cpu_share=1.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 01/13/2025 02:13:14.131 7f8bd73cabc8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-917-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6803236, partition_space_available_1k=43800596, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=127084, cpu_share=1.0, mem_res=116224, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51144, cpu_share=0.0, mem_res=39344, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1102404, free=4675644, buffers=231208, cached=1930204, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.19, five_min_avg=0.48, fifteen_min_avg=0.45, cpu_share=6.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 01/13/2025 02:14:14.151 7f8bd73cabc8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-917-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6803284, partition_space_available_1k=43800548, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=128196, cpu_share=1.0, mem_res=117280, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51536, cpu_share=0.0, mem_res=39352, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1107540, free=4670116, buffers=231244, cached=1930560, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.22, five_min_avg=0.42, fifteen_min_avg=0.43, cpu_share=1.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 01/13/2025 02:14:43.079 7f8bd4c56c18 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectVRouter:NodeStatusUVE] map 01/13/2025 02:15:14.151 7f8bd73cabc8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-917-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6803348, partition_space_available_1k=43800484, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=128488, cpu_share=1.0, mem_res=117544, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51480, cpu_share=0.0, mem_res=39352, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1107088, free=4669260, buffers=232004, cached=1931108, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.13, five_min_avg=0.36, fifteen_min_avg=0.41, cpu_share=2.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 01/13/2025 02:16:14.190 7f8bd73cabc8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-917-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6803780, partition_space_available_1k=43800052, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=143920, cpu_share=1.5, mem_res=131468, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51528, cpu_share=0.0, mem_res=39236, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1166816, free=4427660, buffers=235220, cached=2109764, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.82, five_min_avg=0.51, fifteen_min_avg=0.46, cpu_share=4.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 01/13/2025 02:16:14.190 7f8bd73cabc8 [contrail-vrouter-nodemgr] [ERROR]: LB stats failure a bytes-like object is required, not 'str' 01/13/2025 02:17:14.174 7f8bd73cabc8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-917-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7085160, partition_space_available_1k=43518672, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=141756, cpu_share=4.0, mem_res=122400, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51544, cpu_share=0.0, mem_res=39252, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1159220, free=4298040, buffers=237588, cached=2244612, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.9, five_min_avg=0.64, fifteen_min_avg=0.51, cpu_share=4.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 01/13/2025 02:17:14.175 7f8bd73cabc8 [contrail-vrouter-nodemgr] [DEBUG]: Add uve in the [ObjectLBTable:UveLoadbalancerTrace] map 01/13/2025 02:18:14.190 7f8bd73cabc8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-917-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7087340, partition_space_available_1k=43516492, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=147876, cpu_share=1.5, mem_res=128060, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51624, cpu_share=0.0, mem_res=39364, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1217704, free=4228588, buffers=239160, cached=2254008, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=1.07, five_min_avg=0.69, fifteen_min_avg=0.53, cpu_share=5.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 01/13/2025 02:19:14.215 7f8bd73cabc8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-917-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7095696, partition_space_available_1k=43508136, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=148768, cpu_share=1.0, mem_res=128516, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51564, cpu_share=0.0, mem_res=39448, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1225824, free=4220008, buffers=239172, cached=2254456, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.78, five_min_avg=0.64, fifteen_min_avg=0.52, cpu_share=2.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 01/13/2025 02:20:14.210 7f8bd73cabc8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-917-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7095892, partition_space_available_1k=43507940, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=149792, cpu_share=1.0, mem_res=129440, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51512, cpu_share=0.0, mem_res=39300, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1227680, free=4217712, buffers=239188, cached=2254880, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.5, five_min_avg=0.61, fifteen_min_avg=0.52, cpu_share=2.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 01/13/2025 02:20:41.811 7f8bd721ba20 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectVRouter:NodeStatusUVE] map 01/13/2025 02:21:14.222 7f8bd73cabc8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-917-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7095408, partition_space_available_1k=43508424, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=152508, cpu_share=0.5, mem_res=131684, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51524, cpu_share=0.0, mem_res=39348, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1186856, free=4259256, buffers=240000, cached=2253348, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=1.35, five_min_avg=0.84, fifteen_min_avg=0.61, cpu_share=4.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 01/13/2025 02:22:14.233 7f8bd73cabc8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-917-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7094928, partition_space_available_1k=43508904, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=153172, cpu_share=0.5, mem_res=132212, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51552, cpu_share=0.0, mem_res=39248, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1140956, free=4308224, buffers=240092, cached=2250188, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=1.15, five_min_avg=0.92, fifteen_min_avg=0.65, cpu_share=2.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 01/13/2025 02:23:14.244 7f8bd73cabc8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-917-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7095032, partition_space_available_1k=43508800, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=153544, cpu_share=0.5, mem_res=132608, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51568, cpu_share=0.0, mem_res=39288, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1140064, free=4308744, buffers=240120, cached=2250532, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.5, five_min_avg=0.78, fifteen_min_avg=0.62, cpu_share=3.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 01/13/2025 02:24:14.269 7f8bd73cabc8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-917-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7095076, partition_space_available_1k=43508756, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=154064, cpu_share=0.5, mem_res=133004, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51608, cpu_share=0.0, mem_res=39424, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1140032, free=4308712, buffers=240140, cached=2250576, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.24, five_min_avg=0.65, fifteen_min_avg=0.58, cpu_share=1.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 01/13/2025 02:25:14.267 7f8bd73cabc8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-917-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7427256, partition_space_available_1k=43176576, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=155028, cpu_share=0.5, mem_res=133976, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51576, cpu_share=0.0, mem_res=39296, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1145924, free=3944256, buffers=246352, cached=2602928, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.77, five_min_avg=0.79, fifteen_min_avg=0.63, cpu_share=4.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 01/13/2025 02:25:18.868 7f8bd721ba20 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectVRouter:NodeStatusUVE] map 01/13/2025 02:26:14.281 7f8bd73cabc8 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-917-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7427124, partition_space_available_1k=43176708, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=155168, cpu_share=0.5, mem_res=134220, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51684, cpu_share=0.0, mem_res=39364, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1139596, free=3950048, buffers=247088, cached=2602728, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.35, five_min_avg=0.67, fifteen_min_avg=0.6, cpu_share=2.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 01/13/2025 02:27:07.049 7f8bd5741198 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectVRouter:NodeStatusUVE] map