01/27/2025 02:07:29.528 7f1a387e2438 [contrail-control-nodemgr] [ERROR]: Cannot write http_port 8101 to /tmp/contrail-control-nodemgr.0.http_port 01/27/2025 02:07:29.528 7f1a387e2438 [contrail-control-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8101 01/27/2025 02:07:29.531 7f1a387e6d68 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-130-1.cluster.local process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/27/2025 02:07:29.531 7f1a387e6d68 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-k8s-manifests-130-1.cluster.local:Control:contrail-control-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8101 start_time = 1737943649530750 collector_name = collector_ip = collector_list = [ 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 01/27/2025 02:07:30.243 7f1a410b8a20 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-130-1.cluster.local build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-01-27 00:53:07.027630", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7560-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 4 num_core_per_socket = 4 num_thread_per_core = 1 >> running_package_version = nightly-nightly.el7 installed_package_version = nightly-nightly.el7 >> 01/27/2025 02:07:30.244 7f1a410b8a20 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-130-1.cluster.local process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/27/2025 02:07:30.244 7f1a410b8a20 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-130-1.cluster.local deleted = False process_info = [ << process_name = contrail-control process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737943590000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-dns process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737943628000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-named process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737943643000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-control-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737943644000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-01-27 00:53:07.027630", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7560-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 01/27/2025 02:07:30.251 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:07:33.535 7f1a37f4b240 [contrail-control-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-130-1.cluster.local process_status = [ << module_id = contrail-control-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/27/2025 02:08:30.246 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:09:30.258 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:10:30.268 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:11:30.280 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:12:30.299 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:13:30.299 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:14:30.303 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:15:30.314 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:16:30.318 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:17:30.331 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:18:30.328 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:19:30.333 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:20:30.335 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:21:30.337 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:22:30.345 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:23:30.339 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:24:30.354 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:25:30.368 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:26:30.382 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:27:30.401 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:28:30.406 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:29:30.417 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:30:30.427 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:31:30.438 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:32:30.451 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:33:30.451 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:34:30.456 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:35:30.465 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:36:30.469 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:37:30.479 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:38:30.476 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:39:30.480 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:40:30.483 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:41:30.483 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:42:30.494 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:43:30.502 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:44:30.515 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:45:30.533 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:46:30.540 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:47:30.557 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:48:30.559 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:49:30.571 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:50:30.578 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:51:30.584 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:52:30.606 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:53:30.617 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:54:30.603 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:55:30.607 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:56:30.612 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes' 01/27/2025 02:57:30.622 7f1a3aed9b48 [contrail-control-nodemgr] [ERROR]: Failed to get core files: [Errno 2] No such file or directory: '/var/crashes'