10/31/2024 02:03:35.281 7f477b525f20 [contrail-vrouter-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 10/31/2024 02:03:35.282 7f477b525f20 [contrail-vrouter-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 10/31/2024 02:03:35.282 7f477b525f20 [contrail-vrouter-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 10/31/2024 02:03:35.290 7f4774efc248 [contrail-vrouter-nodemgr] [ERROR]: Cannot write http_port 8102 to /tmp/contrail-vrouter-nodemgr.0.http_port 10/31/2024 02:03:35.291 7f4774efc248 [contrail-vrouter-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8102 10/31/2024 02:03:35.291 7f4774efc448 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvStart] in state[none] 10/31/2024 02:03:35.292 7f4774efc448 [contrail-vrouter-nodemgr] [DEBUG]: Add uve in the [ObjectVRouter:NodeStatusUVE] map 10/31/2024 02:03:35.292 7f4774efc448 [contrail-vrouter-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/31/2024 02:03:35.293 7f4774efc448 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 10/31/2024 02:03:35.293 7f4774efc448 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:03:35.293 7f4774efc448 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-751-1 process_status = [ << module_id = contrail-vrouter-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/31/2024 02:03:35.293 7f4774efc448 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:03:35.293 7f4774efc448 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:03:35.293 7f4774efc448 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = an-jenkins-deploy-platform-juju-k8s-751-1:Compute:contrail-vrouter-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8102 start_time = 1730340215292720 collector_name = collector_ip = collector_list = [ 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 10/31/2024 02:03:35.293 7f4774efc448 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:03:35.358 7f477b525f20 [contrail-vrouter-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-vrouter-agent', 'group': 'contrail-vrouter-agent', 'pid': 38069374938448116924346147210241029445323444367061952086894057699068987684478, 'start': '1730340211000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-vrouter-nodemgr', 'group': 'contrail-vrouter-nodemgr', 'pid': 16873476723599938937506381128662284021496174885680045731154158567479200183031, 'start': '1730340152000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 10/31/2024 02:03:35.491 7f477b525f20 [contrail-vrouter-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-vrouter-nodemgr', _source='an-jenkins-deploy-platform-juju-k8s-751-1', _node_type='Compute', _instance_id='0', _timestamp=1730340215491189, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-751-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-vrouter-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectVRouter'), _seqnum=0) 10/31/2024 02:03:35.491 7f477b525f20 [contrail-vrouter-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-vrouter-nodemgr', _source='an-jenkins-deploy-platform-juju-k8s-751-1', _node_type='Compute', _instance_id='0', _timestamp=1730340215491780, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-751-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-vrouter-agent', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1730340211000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-vrouter-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1730340152000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2024-10-31 01:12:39.614478", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-6264-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectVRouter'), _seqnum=0) 10/31/2024 02:03:35.495 7f4774efc848 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:03:35.496 7f4774efc848 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-751-1 build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2024-10-31 01:12:39.614478", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-6264-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 2 num_core_per_socket = 2 num_thread_per_core = 1 >> running_package_version = nightly-nightly.el7 installed_package_version = nightly-nightly.el7 >> 10/31/2024 02:03:35.496 7f4774efc848 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:03:35.496 7f4774efc848 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:03:35.496 7f4774efc848 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-751-1 process_status = [ << module_id = contrail-vrouter-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/31/2024 02:03:35.496 7f4774efc848 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:03:35.496 7f4774efc848 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:03:35.496 7f4774efc848 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-751-1 deleted = False process_info = [ << process_name = contrail-vrouter-agent process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1730340211000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-vrouter-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1730340152000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2024-10-31 01:12:39.614478", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-6264-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 10/31/2024 02:03:35.496 7f4774efc848 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:03:38.518 7f477b525f20 [contrail-vrouter-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-vrouter-nodemgr', _source='an-jenkins-deploy-platform-juju-k8s-751-1', _node_type='Compute', _instance_id='0', _timestamp=1730340218518668, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-751-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-vrouter-agent', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1730340211000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-vrouter-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1730340152000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2024-10-31 01:12:39.614478", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-6264-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectVRouter'), _seqnum=0) 10/31/2024 02:03:38.519 7f477b525f20 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-751-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6779996, partition_space_available_1k=43823836, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=247064, cpu_share=0, mem_res=108092, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=72552, cpu_share=0, mem_res=41756, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1178976, free=5124540, buffers=217060, cached=1418884, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=1.87, five_min_avg=0.74, fifteen_min_avg=0.41, cpu_share=0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 10/31/2024 02:03:38.519 7f4774e7c848 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:03:38.519 7f4774e7c848 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-751-1 deleted = False process_info = [ << process_name = contrail-vrouter-agent process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1730340211000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-vrouter-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1730340152000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2024-10-31 01:12:39.614478", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-6264-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 10/31/2024 02:03:38.519 7f4774e7c848 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:03:38.519 7f4774e7c848 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:03:38.519 7f4774e7c848 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-751-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 6779996 partition_space_available_1k = 43823836 percentage_partition_space_used = 13 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-vrouter-agent : << mem_virt = 247064 cpu_share = 0 mem_res = 108092 >>contrail-vrouter-nodemgr : << mem_virt = 72552 cpu_share = 0 mem_res = 41756 >> } system_mem_usage = << total = 7939460 used = 1178976 free = 5124540 buffers = 217060 cached = 1418884 node_type = vrouter >> system_cpu_usage = << one_min_avg = 1.87 five_min_avg = 0.74 fifteen_min_avg = 0.41 cpu_share = 0 node_type = vrouter >> >> 10/31/2024 02:03:38.520 7f4774e7c848 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:03:39.293 7f4774e7c848 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/31/2024 02:03:39.296 7f4774e7c848 [contrail-vrouter-nodemgr] [INFO]: Session Event: TCP Connected 10/31/2024 02:03:39.296 7f4774e7c848 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/31/2024 02:03:39.296 7f4774e7c848 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/31/2024 02:03:39.296 7f4774e7c848 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-751-1 process_status = [ << module_id = contrail-vrouter-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/31/2024 02:03:39.296 7f4774e7c848 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/31/2024 02:03:39.296 7f4774e7c848 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 10/31/2024 02:03:39.296 7f4774e7c848 [contrail-vrouter-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 10/31/2024 02:03:39.297 7f4774e7c848 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 10/31/2024 02:03:39.297 7f4774e7c848 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/31/2024 02:03:39.297 7f4774e7c848 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/31/2024 02:03:39.301 7f4774e7c948 [contrail-vrouter-nodemgr] [DEBUG]: Extracted sandesh length: 0000001013 10/31/2024 02:03:39.302 7f4774e7c948 [contrail-vrouter-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 10/31/2024 02:03:39.302 7f4774e7c848 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 10/31/2024 02:03:39.302 7f4774e7c848 [contrail-vrouter-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 10/31/2024 02:03:39.302 7f4774e7c848 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectVRouter:NodeStatusUVE] map 10/31/2024 02:03:39.303 7f4774e7c848 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/31/2024 02:03:39.303 7f4774e7c848 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 10/31/2024 02:03:39.303 7f4774efc548 [contrail-vrouter-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 10/31/2024 02:03:39.304 7f4774efc548 [contrail-vrouter-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 10/31/2024 02:04:38.527 7f477b525f20 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-751-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6772460, partition_space_available_1k=43831372, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=134040, cpu_share=0.5, mem_res=1636, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=72848, cpu_share=0.0, mem_res=41856, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1162196, free=4959936, buffers=217972, cached=1599356, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=1.29, five_min_avg=0.83, fifteen_min_avg=0.46, cpu_share=7.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 10/31/2024 02:04:47.459 7f93ef66cf20 [contrail-vrouter-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 10/31/2024 02:04:47.459 7f93ef66cf20 [contrail-vrouter-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 10/31/2024 02:04:47.459 7f93ef66cf20 [contrail-vrouter-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 10/31/2024 02:04:47.475 7f93e9084248 [contrail-vrouter-nodemgr] [ERROR]: Cannot write http_port 8102 to /tmp/contrail-vrouter-nodemgr.0.http_port 10/31/2024 02:04:47.476 7f93e9084248 [contrail-vrouter-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8102 10/31/2024 02:04:47.477 7f93e9084448 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvStart] in state[none] 10/31/2024 02:04:47.478 7f93e9084448 [contrail-vrouter-nodemgr] [DEBUG]: Add uve in the [ObjectVRouter:NodeStatusUVE] map 10/31/2024 02:04:47.478 7f93e9084448 [contrail-vrouter-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/31/2024 02:04:47.479 7f93e9084448 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 10/31/2024 02:04:47.479 7f93e9084448 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:04:47.479 7f93e9084448 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-751-1 process_status = [ << module_id = contrail-vrouter-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/31/2024 02:04:47.479 7f93e9084448 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:04:47.479 7f93e9084448 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:04:47.479 7f93e9084448 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = an-jenkins-deploy-platform-juju-k8s-751-1:Compute:contrail-vrouter-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8102 start_time = 1730340287478816 collector_name = collector_ip = collector_list = [ 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 10/31/2024 02:04:47.479 7f93e9084448 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:04:47.524 7f93ef66cf20 [contrail-vrouter-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-vrouter-agent', 'group': 'contrail-vrouter-agent', 'pid': 60791387846773637205031349301752512105833521610853951006690975719744840898859, 'start': '1730340278000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-vrouter-nodemgr', 'group': 'contrail-vrouter-nodemgr', 'pid': 2517125288556851700866402017816763171581142609837291230640884158182952165531, 'start': '1730340285000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 10/31/2024 02:04:47.746 7f93ef66cf20 [contrail-vrouter-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-vrouter-nodemgr', _source='an-jenkins-deploy-platform-juju-k8s-751-1', _node_type='Compute', _instance_id='0', _timestamp=1730340287746456, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-751-1', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-vrouter-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectVRouter'), _seqnum=0) 10/31/2024 02:04:47.747 7f93ef66cf20 [contrail-vrouter-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-vrouter-nodemgr', _source='an-jenkins-deploy-platform-juju-k8s-751-1', _node_type='Compute', _instance_id='0', _timestamp=1730340287746966, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-751-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-vrouter-agent', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1730340278000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-vrouter-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1730340285000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2024-10-31 01:12:39.614478", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-6264-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectVRouter'), _seqnum=0) 10/31/2024 02:04:47.749 7f93e9084848 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:04:47.750 7f93e9084848 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-751-1 build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2024-10-31 01:12:39.614478", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-6264-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 2 num_core_per_socket = 2 num_thread_per_core = 1 >> running_package_version = nightly-nightly.el7 installed_package_version = nightly-nightly.el7 >> 10/31/2024 02:04:47.750 7f93e9084848 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:04:47.750 7f93e9084848 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:04:47.750 7f93e9084848 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-751-1 process_status = [ << module_id = contrail-vrouter-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/31/2024 02:04:47.750 7f93e9084848 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:04:47.751 7f93e9084848 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:04:47.751 7f93e9084848 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-751-1 deleted = False process_info = [ << process_name = contrail-vrouter-agent process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1730340278000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-vrouter-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1730340285000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2024-10-31 01:12:39.614478", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-6264-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 10/31/2024 02:04:47.751 7f93e9084848 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:04:48.111 7f93e9000848 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectVRouter:NodeStatusUVE] map 10/31/2024 02:04:50.796 7f93ef66cf20 [contrail-vrouter-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-vrouter-nodemgr', _source='an-jenkins-deploy-platform-juju-k8s-751-1', _node_type='Compute', _instance_id='0', _timestamp=1730340290796335, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-751-1', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-vrouter-agent', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1730340278000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-vrouter-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1730340285000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2024-10-31 01:12:39.614478", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-6264-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectVRouter'), _seqnum=0) 10/31/2024 02:04:50.796 7f93ef66cf20 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-751-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6776932, partition_space_available_1k=43826900, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=152136, cpu_share=0, mem_res=108672, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52784, cpu_share=0, mem_res=41780, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1179772, free=4849472, buffers=218544, cached=1691672, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=1.4, five_min_avg=0.87, fifteen_min_avg=0.48, cpu_share=0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 10/31/2024 02:04:50.797 7f93e9000848 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:04:50.797 7f93e9000848 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-751-1 deleted = False process_info = [ << process_name = contrail-vrouter-agent process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1730340278000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-vrouter-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1730340285000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2024-10-31 01:12:39.614478", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-6264-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 10/31/2024 02:04:50.797 7f93e9000848 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:04:50.797 7f93e9000848 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:04:50.797 7f93e9000848 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-751-1 disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 6776932 partition_space_available_1k = 43826900 percentage_partition_space_used = 13 >> } all_core_file_list = [ ] process_mem_cpu_usage = { contrail-vrouter-agent : << mem_virt = 152136 cpu_share = 0 mem_res = 108672 >>contrail-vrouter-nodemgr : << mem_virt = 52784 cpu_share = 0 mem_res = 41780 >> } system_mem_usage = << total = 7939460 used = 1179772 free = 4849472 buffers = 218544 cached = 1691672 node_type = vrouter >> system_cpu_usage = << one_min_avg = 1.4 five_min_avg = 0.87 fifteen_min_avg = 0.48 cpu_share = 0 node_type = vrouter >> >> 10/31/2024 02:04:50.797 7f93e9000848 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:04:51.478 7f93e9000848 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/31/2024 02:04:51.481 7f93e9000848 [contrail-vrouter-nodemgr] [INFO]: Session Event: TCP Connected 10/31/2024 02:04:51.482 7f93e9000848 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/31/2024 02:04:51.482 7f93e9000848 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/31/2024 02:04:51.482 7f93e9000848 [contrail-vrouter-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = an-jenkins-deploy-platform-juju-k8s-751-1 process_status = [ << module_id = contrail-vrouter-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/31/2024 02:04:51.482 7f93e9000848 [contrail-vrouter-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/31/2024 02:04:51.482 7f93e9000848 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 10/31/2024 02:04:51.482 7f93e9000848 [contrail-vrouter-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 10/31/2024 02:04:51.483 7f93e9000848 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 10/31/2024 02:04:51.483 7f93e9000848 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/31/2024 02:04:51.483 7f93e9000848 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/31/2024 02:04:51.487 7f93e9000948 [contrail-vrouter-nodemgr] [DEBUG]: Extracted sandesh length: 0000001013 10/31/2024 02:04:51.488 7f93e9000948 [contrail-vrouter-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 10/31/2024 02:04:51.488 7f93e9000848 [contrail-vrouter-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 10/31/2024 02:04:51.488 7f93e9000848 [contrail-vrouter-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 10/31/2024 02:04:51.488 7f93e9000848 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectVRouter:NodeStatusUVE] map 10/31/2024 02:04:51.488 7f93e9000848 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/31/2024 02:04:51.489 7f93e9000848 [contrail-vrouter-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 10/31/2024 02:04:51.489 7f93e9084548 [contrail-vrouter-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 10/31/2024 02:04:51.490 7f93e9084548 [contrail-vrouter-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 10/31/2024 02:05:50.776 7f93ef66cf20 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-751-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6780684, partition_space_available_1k=43823148, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=154008, cpu_share=0.5, mem_res=110480, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52892, cpu_share=0.0, mem_res=41924, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1142616, free=4819660, buffers=218604, cached=1758580, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.8, five_min_avg=0.82, fifteen_min_avg=0.49, cpu_share=13.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 10/31/2024 02:06:50.785 7f93ef66cf20 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-751-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6780120, partition_space_available_1k=43823712, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=157376, cpu_share=0.5, mem_res=113444, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52904, cpu_share=0.0, mem_res=41928, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1180116, free=4715824, buffers=218768, cached=1824752, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.29, five_min_avg=0.66, fifteen_min_avg=0.45, cpu_share=1.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 10/31/2024 02:07:50.798 7f93ef66cf20 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-751-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6835804, partition_space_available_1k=43768028, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=159508, cpu_share=0.5, mem_res=115432, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52832, cpu_share=0.0, mem_res=41836, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1157788, free=4737340, buffers=218824, cached=1825508, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.11, five_min_avg=0.54, fifteen_min_avg=0.42, cpu_share=0.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 10/31/2024 02:08:50.810 7f93ef66cf20 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-751-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6835960, partition_space_available_1k=43767872, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=161144, cpu_share=0.5, mem_res=116884, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=52896, cpu_share=0.0, mem_res=41836, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1160644, free=4732728, buffers=218912, cached=1827176, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.24, five_min_avg=0.49, fifteen_min_avg=0.41, cpu_share=4.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 10/31/2024 02:09:42.498 7f93e9084848 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectVRouter:NodeStatusUVE] map 10/31/2024 02:09:50.823 7f93ef66cf20 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-751-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6836020, partition_space_available_1k=43767812, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=162152, cpu_share=0.5, mem_res=117940, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53280, cpu_share=0.0, mem_res=42028, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1168508, free=4722848, buffers=219660, cached=1828444, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.46, five_min_avg=0.53, fifteen_min_avg=0.43, cpu_share=1.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 10/31/2024 02:10:50.822 7f93ef66cf20 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-751-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6836096, partition_space_available_1k=43767736, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=162500, cpu_share=0.5, mem_res=118072, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53284, cpu_share=0.0, mem_res=41980, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1196996, free=4684532, buffers=220116, cached=1837816, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.17, five_min_avg=0.43, fifteen_min_avg=0.4, cpu_share=1.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 10/31/2024 02:11:50.836 7f93ef66cf20 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-751-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7118828, partition_space_available_1k=43485004, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=175736, cpu_share=2.5, mem_res=122408, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53284, cpu_share=0.0, mem_res=41964, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1226160, free=4343208, buffers=225196, cached=2144896, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.32, five_min_avg=0.44, fifteen_min_avg=0.4, cpu_share=4.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 10/31/2024 02:11:50.837 7f93ef66cf20 [contrail-vrouter-nodemgr] [ERROR]: LB stats failure a bytes-like object is required, not 'str' 10/31/2024 02:12:50.847 7f93ef66cf20 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-751-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7120704, partition_space_available_1k=43483128, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=181564, cpu_share=2.0, mem_res=128336, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53292, cpu_share=0.0, mem_res=41984, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1276816, free=4283312, buffers=226376, cached=2152956, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.63, five_min_avg=0.51, fifteen_min_avg=0.43, cpu_share=4.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 10/31/2024 02:12:50.848 7f93ef66cf20 [contrail-vrouter-nodemgr] [DEBUG]: Add uve in the [ObjectLBTable:UveLoadbalancerTrace] map 10/31/2024 02:13:50.859 7f93ef66cf20 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-751-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7120968, partition_space_available_1k=43482864, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=182284, cpu_share=1.0, mem_res=128728, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53328, cpu_share=0.0, mem_res=41956, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1283936, free=4273980, buffers=226552, cached=2154992, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.3, five_min_avg=0.44, fifteen_min_avg=0.41, cpu_share=5.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 10/31/2024 02:14:50.878 7f93ef66cf20 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-751-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7121152, partition_space_available_1k=43482680, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=183492, cpu_share=0.5, mem_res=129784, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53328, cpu_share=0.0, mem_res=42024, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1234808, free=4321496, buffers=226580, cached=2156576, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.11, five_min_avg=0.36, fifteen_min_avg=0.38, cpu_share=1.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 10/31/2024 02:14:53.359 7f93e9084848 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectVRouter:NodeStatusUVE] map 10/31/2024 02:15:50.875 7f93ef66cf20 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-751-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7121348, partition_space_available_1k=43482484, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=185796, cpu_share=0.5, mem_res=131500, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53376, cpu_share=0.0, mem_res=42028, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1206428, free=4351412, buffers=227228, cached=2154392, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.52, five_min_avg=0.4, fifteen_min_avg=0.39, cpu_share=3.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 10/31/2024 02:16:50.886 7f93ef66cf20 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-751-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7120428, partition_space_available_1k=43483404, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=186856, cpu_share=0.5, mem_res=132292, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53336, cpu_share=0.0, mem_res=41960, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1172000, free=4388264, buffers=227276, cached=2151920, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.26, five_min_avg=0.34, fifteen_min_avg=0.37, cpu_share=1.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 10/31/2024 02:17:50.897 7f93ef66cf20 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-751-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7128520, partition_space_available_1k=43475312, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=186988, cpu_share=0.5, mem_res=132424, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53348, cpu_share=0.0, mem_res=41984, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1146268, free=4413432, buffers=227312, cached=2152448, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.1, five_min_avg=0.28, fifteen_min_avg=0.34, cpu_share=2.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 10/31/2024 02:18:50.907 7f93ef66cf20 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-751-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7128568, partition_space_available_1k=43475264, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=187136, cpu_share=0.5, mem_res=132556, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53352, cpu_share=0.0, mem_res=41964, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1146212, free=4413400, buffers=227336, cached=2152512, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.03, five_min_avg=0.23, fifteen_min_avg=0.32, cpu_share=0.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 10/31/2024 02:19:50.930 7f93ef66cf20 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-751-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7128616, partition_space_available_1k=43475216, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=187404, cpu_share=0.5, mem_res=132688, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53384, cpu_share=0.0, mem_res=42256, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1134992, free=4424788, buffers=227356, cached=2152324, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.01, five_min_avg=0.18, fifteen_min_avg=0.3, cpu_share=0.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 10/31/2024 02:20:38.541 7f93e9084548 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectVRouter:NodeStatusUVE] map 10/31/2024 02:20:50.931 7f93ef66cf20 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-751-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7128684, partition_space_available_1k=43475148, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=187984, cpu_share=0.5, mem_res=133348, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53436, cpu_share=0.0, mem_res=41980, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1133568, free=4425976, buffers=227408, cached=2152508, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.07, five_min_avg=0.16, fifteen_min_avg=0.28, cpu_share=1.5, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 10/31/2024 02:21:50.945 7f93ef66cf20 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-751-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7460952, partition_space_available_1k=43142880, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=189296, cpu_share=0.5, mem_res=134672, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53440, cpu_share=0.0, mem_res=42040, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1160060, free=4040484, buffers=233688, cached=2505228, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.31, five_min_avg=0.22, fifteen_min_avg=0.29, cpu_share=3.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 10/31/2024 02:22:50.946 7f93ef66cf20 [contrail-vrouter-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='an-jenkins-deploy-platform-juju-k8s-751-1', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7460816, partition_space_available_1k=43143016, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-vrouter-agent': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=189608, cpu_share=0.5, mem_res=134828, _EventManager__key='contrail-vrouter-agent'), 'contrail-vrouter-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=53456, cpu_share=0.0, mem_res=42016, _EventManager__key='contrail-vrouter-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=7939460, used=1138716, free=4061828, buffers=233756, cached=2505160, node_type='vrouter'), system_cpu_usage=SysCpuInfo(one_min_avg=0.11, five_min_avg=0.18, fifteen_min_avg=0.27, cpu_share=2.0, node_type='vrouter'), running_package_version=None, installed_package_version=None, _table='ObjectVRouter') 10/31/2024 02:23:35.625 7f93e9084548 [contrail-vrouter-nodemgr] [DEBUG]: send sync_uve in the [ObjectVRouter:NodeStatusUVE] map