2025-04-14 Mon 01:58:40:139.100 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140150005041280, Pid 1]: SANDESH: No Client: 1744595920138987  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local:Control:contrail-control:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8083 start_time = 1744595920138888 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 0,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-04-14 Mon 01:58:40:140.026 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149846976256, Pid 1]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while connecting to RabbitMQ: 10.0.0.129:5673 : a socket error occurred src/contrail-common/config-client-mgr/config_amqp_client.cc 220
2025-04-14 Mon 01:58:40:140.955 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149842777856, Pid 1]: SANDESH: Send FAILED: 1744595920139641  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.129:5673,  ] ] status = Down description = RabbitMQ connection down ],  ] ] flag_infos= [  [ ] ] description = Number of connections:1, Expected:3 Missing: Database:Cassandra,Collector, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2025-04-14 Mon 01:58:40:140.991 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149842777856, Pid 1]: SANDESH: Send FAILED: 1744595920140135  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Idle : EvStart -> Disconnect ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.129:5673,  ] ] status = Down description = RabbitMQ connection down ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2025-04-14 Mon 01:58:40:141.131 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149842777856, Pid 1]: SANDESH: Send FAILED: 1744595920140205  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local:Control:contrail-control:0 client_info= [  status = Disconnect successful_connections = 0 pid = 1 http_port = 8083 start_time = 1744595920138888 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 5,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-04-14 Mon 01:58:40:141.267 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149842777856, Pid 1]: SANDESH: Send FAILED: 1744595920140261  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local:Control:contrail-control:0 client_info= [  status = Disconnect successful_connections = 0 pid = 1 http_port = 8083 start_time = 1744595920138888 collector_name =  collector_ip = 10.0.0.129:8086 collector_list= [  [ (*_iter40) = 10.0.0.129:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 5,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-04-14 Mon 01:58:40:141.296 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149842777856, Pid 1]: SANDESH: Send FAILED: 1744595920140279  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.129:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.129:5673,  ] ] status = Down description = RabbitMQ connection down ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2025-04-14 Mon 01:58:40:141.345 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149842777856, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2025-04-14 Mon 01:58:40:141.498 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149842777856, Pid 1]: SANDESH: Send FAILED: 1744595920140924  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local:Control:contrail-control:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8083 start_time = 1744595920138888 collector_name =  collector_ip = 10.0.0.129:8086 collector_list= [  [ (*_iter40) = 10.0.0.129:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 5,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-04-14 Mon 01:58:40:141.525 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149842777856, Pid 1]: SANDESH: Send FAILED: 1744595920141320  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.129:5673,  ] ] status = Down description = RabbitMQ connection down ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2025-04-14 Mon 01:58:40:141.662 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149842777856, Pid 1]: SANDESH: Send FAILED: 1744595920141413  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local:Control:contrail-control:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8083 start_time = 1744595920138888 collector_name =  collector_ip = 10.0.0.129:8086 collector_list= [  [ (*_iter40) = 10.0.0.129:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 6,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 5,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-04-14 Mon 01:58:41:142.402 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149744723712, Pid 1]: SANDESH: Send FAILED: 1744595921141509  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.129:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.129:5673,  ] ] status = Down description = RabbitMQ connection down ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2025-04-14 Mon 01:58:41:142.500 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149744723712, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2025-04-14 Mon 01:58:41:142.722 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149744723712, Pid 1]: SANDESH: Send FAILED: 1744595921142352  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local:Control:contrail-control:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8083 start_time = 1744595920138888 collector_name =  collector_ip = 10.0.0.129:8086 collector_list= [  [ (*_iter40) = 10.0.0.129:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 6,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 8,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-04-14 Mon 01:58:41:142.753 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149744723712, Pid 1]: SANDESH: Send FAILED: 1744595921142479  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.129:5673,  ] ] status = Down description = RabbitMQ connection down ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2025-04-14 Mon 01:58:41:142.899 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149744723712, Pid 1]: SANDESH: Send FAILED: 1744595921142581  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local:Control:contrail-control:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8083 start_time = 1744595920138888 collector_name =  collector_ip = 10.0.0.129:8086 collector_list= [  [ (*_iter40) = 10.0.0.129:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 7,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 9,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-04-14 Mon 01:58:43:147.625 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149838579456, Pid 1]: SANDESH: Send FAILED: 1744595923143199  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.129:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.129:5673,  ] ] status = Down description = RabbitMQ connection down ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2025-04-14 Mon 01:58:43:148.500 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149838579456, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2025-04-14 Mon 01:58:43:148.865 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149838579456, Pid 1]: SANDESH: Send FAILED: 1744595923147576  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local:Control:contrail-control:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8083 start_time = 1744595920138888 collector_name =  collector_ip = 10.0.0.129:8086 collector_list= [  [ (*_iter40) = 10.0.0.129:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 7,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 12,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-04-14 Mon 01:58:43:153.019 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149838579456, Pid 1]: SANDESH: Send FAILED: 1744595923148424  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.129:5673,  ] ] status = Down description = RabbitMQ connection down ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2025-04-14 Mon 01:58:43:153.212 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149838579456, Pid 1]: SANDESH: Send FAILED: 1744595923148657  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local:Control:contrail-control:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8083 start_time = 1744595920138888 collector_name =  collector_ip = 10.0.0.129:8086 collector_list= [  [ (*_iter40) = 10.0.0.129:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 8,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 13,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-04-14 Mon 01:58:45:142.098 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149846976256, Pid 1]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while connecting to RabbitMQ: 10.0.0.129:5673 : a socket error occurred src/contrail-common/config-client-mgr/config_amqp_client.cc 220
2025-04-14 Mon 01:58:47:154.747 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149748922112, Pid 1]: SANDESH: Send FAILED: 1744595927152595  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.129:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.129:5673,  ] ] status = Down description = RabbitMQ connection down ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2025-04-14 Mon 01:58:47:154.842 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149748922112, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2025-04-14 Mon 01:58:47:155.300 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149748922112, Pid 1]: SANDESH: Send FAILED: 1744595927154700  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local:Control:contrail-control:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8083 start_time = 1744595920138888 collector_name =  collector_ip = 10.0.0.129:8086 collector_list= [  [ (*_iter40) = 10.0.0.129:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 9,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 16,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-04-14 Mon 01:58:47:155.365 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149748922112, Pid 1]: SANDESH: Send FAILED: 1744595927154812  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.129:5673,  ] ] status = Down description = RabbitMQ connection down ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2025-04-14 Mon 01:58:47:155.528 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149748922112, Pid 1]: SANDESH: Send FAILED: 1744595927155134  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local:Control:contrail-control:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8083 start_time = 1744595920138888 collector_name =  collector_ip = 10.0.0.129:8086 collector_list= [  [ (*_iter40) = 10.0.0.129:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 10,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 17,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-04-14 Mon 01:58:50:142.471 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149846976256, Pid 1]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while connecting to RabbitMQ: 10.0.0.129:5673 : a socket error occurred src/contrail-common/config-client-mgr/config_amqp_client.cc 220
2025-04-14 Mon 01:58:55:143.337 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149846976256, Pid 1]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while connecting to RabbitMQ: 10.0.0.129:5673 : a socket error occurred src/contrail-common/config-client-mgr/config_amqp_client.cc 220
2025-04-14 Mon 01:58:55:156.178 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149842777856, Pid 1]: SANDESH: Send FAILED: 1744595935155843  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.129:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.129:5673,  ] ] status = Down description = RabbitMQ connection down ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2025-04-14 Mon 01:58:55:156.316 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149842777856, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2025-04-14 Mon 01:58:55:156.573 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149842777856, Pid 1]: SANDESH: Send FAILED: 1744595935156146  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local:Control:contrail-control:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8083 start_time = 1744595920138888 collector_name =  collector_ip = 10.0.0.129:8086 collector_list= [  [ (*_iter40) = 10.0.0.129:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 12,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 20,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-04-14 Mon 01:58:55:156.626 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149842777856, Pid 1]: SANDESH: Send FAILED: 1744595935156296  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.129:5673,  ] ] status = Down description = RabbitMQ connection down ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2025-04-14 Mon 01:58:55:156.801 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149842777856, Pid 1]: SANDESH: Send FAILED: 1744595935156396  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local:Control:contrail-control:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8083 start_time = 1744595920138888 collector_name =  collector_ip = 10.0.0.129:8086 collector_list= [  [ (*_iter40) = 10.0.0.129:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 13,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 21,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-04-14 Mon 01:59:00:143.975 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149846976256, Pid 1]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while connecting to RabbitMQ: 10.0.0.129:5673 : a socket error occurred src/contrail-common/config-client-mgr/config_amqp_client.cc 220
2025-04-14 Mon 01:59:05:341.964 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149727930112, Pid 1]: SANDESH: Send FAILED: 1744595945340522  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.129:5673,  ] ] status = Up description = RabbitMQ connection established ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2025-04-14 Mon 01:59:05:342.016 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149727930112, Pid 1]: SANDESH: Send FAILED: 1744595945340599  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name = Cassandra server_addrs= [  [ (*_iter6) = 10.0.0.129:9041,  ] ] status = Down description = Lost Cassandra connection ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.129:5673,  ] ] status = Up description = RabbitMQ connection established ],  ] ] flag_infos= [  [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2025-04-14 Mon 01:59:10:151.496 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149744723712, Pid 1]: SANDESH: Send FAILED: 1744595950150964  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local:Control:contrail-control:0 sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvIdleHoldTimerExpired enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 26 dequeues = 26 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 42 dequeues = 42 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1744595935156345 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1744595945342003 ] max_sm_queue_count = 7 ]
2025-04-14 Mon 01:59:10:152.160 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149744723712, Pid 1]: SANDESH: Send FAILED: 1744595950151249  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local:Control:contrail-control:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8083 start_time = 1744595920138888 collector_name =  collector_ip = 10.0.0.129:8086 collector_list= [  [ (*_iter40) = 10.0.0.129:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ConfigCassInitErrorMessage [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 21,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 26,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-04-14 Mon 01:59:11:161.277 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149830182656, Pid 1]: SANDESH: Send FAILED: 1744595951160991  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.129:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name = Cassandra server_addrs= [  [ (*_iter6) = 10.0.0.129:9041,  ] ] status = Down description = Lost Cassandra connection ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.129:5673,  ] ] status = Up description = RabbitMQ connection established ],  ] ] flag_infos= [  [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2025-04-14 Mon 01:59:11:161.448 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149830182656, Pid 1]: SANDESH: Send FAILED: 1744595951161236  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local:Control:contrail-control:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8083 start_time = 1744595920138888 collector_name =  collector_ip = 10.0.0.129:8086 collector_list= [  [ (*_iter40) = 10.0.0.129:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ConfigCassInitErrorMessage [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 22,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 28,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-04-14 Mon 01:59:11:168.435 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149842777856, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2025-04-14 Mon 01:59:11:168.590 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149842777856, Pid 1]: SANDESH: Send FAILED: 1744595951168412  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name = Cassandra server_addrs= [  [ (*_iter6) = 10.0.0.129:9041,  ] ] status = Down description = Lost Cassandra connection ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.129:5673,  ] ] status = Up description = RabbitMQ connection established ],  ] ] flag_infos= [  [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2025-04-14 Mon 01:59:11:168.756 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149842777856, Pid 1]: SANDESH: Send FAILED: 1744595951168563  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local:Control:contrail-control:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8083 start_time = 1744595920138888 collector_name =  collector_ip = 10.0.0.129:8086 collector_list= [  [ (*_iter40) = 10.0.0.129:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ConfigCassInitErrorMessage [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 23,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 30,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-04-14 Mon 01:59:26:645.591 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149744723712, Pid 1]: SANDESH: Send FAILED: 1744595966645462  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name = Cassandra server_addrs= [  [ (*_iter6) = 10.0.0.129:9041,  ] ] status = Up description = Established Cassandra connection ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.129:5673,  ] ] status = Up description = RabbitMQ connection established ],  ] ] flag_infos= [  [ ] ] description = Collector connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2025-04-14 Mon 01:59:27:188.001 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149846976256, Pid 1]: SANDESH: Send FAILED: 1744595967187956  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name = Cassandra server_addrs= [  [ (*_iter6) = 10.0.0.129:9041,  ] ] status = Up description = Established Cassandra connection ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.129:5673,  ] ] status = Up description = RabbitMQ connection established ],  ] ] flag_infos= [  [ ] ] description = Collector connection down, No BGP configuration for self ],  ] ] ]
2025-04-14 Mon 01:59:33:702.994 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149842777856, Pid 1]: SANDESH: Send FAILED: 1744595973702768  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:ip-fabric operation =  add_import_rt= [  [ (*_iter24) = target:64512:7999999,  ] ] hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1238
2025-04-14 Mon 01:59:33:741.483 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149842777856, Pid 1]: SANDESH: Send FAILED: 1744595973702791  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:ip-fabric operation = Add family = inet hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2025-04-14 Mon 01:59:33:741.530 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149842777856, Pid 1]: SANDESH: Send FAILED: 1744595973702831  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:ip-fabric operation = Add family = inet6 hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2025-04-14 Mon 01:59:33:741.553 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149842777856, Pid 1]: SANDESH: Send FAILED: 1744595973702893  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:ip-fabric operation = Add family = erm-vpn hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2025-04-14 Mon 01:59:33:741.565 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149842777856, Pid 1]: SANDESH: Send FAILED: 1744595973702916  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:ip-fabric operation = Add family = e-vpn hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2025-04-14 Mon 01:59:33:741.577 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149842777856, Pid 1]: SANDESH: Send FAILED: 1744595973702931  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:ip-fabric operation = Add family = inet-mvpn hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2025-04-14 Mon 01:59:34:349.617 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149727930112, Pid 1]: SANDESH: Send FAILED: 1744595974349442  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:__link_local__ instance_name = default-domain:default-project:__link_local__:__link_local__ operation =  add_import_rt= [  [ (*_iter24) = target:64512:7999999,  ] ] hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1238
2025-04-14 Mon 01:59:34:349.666 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149727930112, Pid 1]: SANDESH: Send FAILED: 1744595974349465  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:__link_local__ instance_name = default-domain:default-project:__link_local__:__link_local__ operation = Add family = inet hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2025-04-14 Mon 01:59:34:349.691 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149727930112, Pid 1]: SANDESH: Send FAILED: 1744595974349493  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:__link_local__ instance_name = default-domain:default-project:__link_local__:__link_local__ operation = Add family = inet6 hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2025-04-14 Mon 01:59:34:349.702 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149727930112, Pid 1]: SANDESH: Send FAILED: 1744595974349526  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:__link_local__ instance_name = default-domain:default-project:__link_local__:__link_local__ operation = Add family = erm-vpn hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2025-04-14 Mon 01:59:34:349.712 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149727930112, Pid 1]: SANDESH: Send FAILED: 1744595974349551  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:__link_local__ instance_name = default-domain:default-project:__link_local__:__link_local__ operation = Add family = e-vpn hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2025-04-14 Mon 01:59:34:349.728 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149727930112, Pid 1]: SANDESH: Send FAILED: 1744595974349565  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:__link_local__ instance_name = default-domain:default-project:__link_local__:__link_local__ operation = Add family = inet-mvpn hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2025-04-14 Mon 01:59:34:884.579 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149736326912, Pid 1]: SANDESH: Send FAILED: 1744595974884403  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:dci-network operation =  add_import_rt= [  [ (*_iter24) = target:64512:7999999,  ] ] hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1238
2025-04-14 Mon 01:59:34:884.624 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149736326912, Pid 1]: SANDESH: Send FAILED: 1744595974884428  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:dci-network operation = Add family = inet hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2025-04-14 Mon 01:59:34:884.638 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149736326912, Pid 1]: SANDESH: Send FAILED: 1744595974884459  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:dci-network operation = Add family = inet6 hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2025-04-14 Mon 01:59:34:884.648 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149736326912, Pid 1]: SANDESH: Send FAILED: 1744595974884491  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:dci-network operation = Add family = erm-vpn hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2025-04-14 Mon 01:59:34:884.659 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149736326912, Pid 1]: SANDESH: Send FAILED: 1744595974884514  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:dci-network operation = Add family = e-vpn hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2025-04-14 Mon 01:59:34:884.679 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149736326912, Pid 1]: SANDESH: Send FAILED: 1744595974884528  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:dci-network operation = Add family = inet-mvpn hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2025-04-14 Mon 01:59:34:957.443 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149846976256, Pid 1]: SANDESH: Send FAILED: 1744595974957270  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:__default__ operation =  add_import_rt= [  [ (*_iter24) = target:64512:7999999,  ] ] hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1238
2025-04-14 Mon 01:59:34:957.486 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149846976256, Pid 1]: SANDESH: Send FAILED: 1744595974957298  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:__default__ operation = Add family = inet hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2025-04-14 Mon 01:59:34:957.499 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149846976256, Pid 1]: SANDESH: Send FAILED: 1744595974957327  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:__default__ operation = Add family = inet6 hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2025-04-14 Mon 01:59:34:957.510 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149846976256, Pid 1]: SANDESH: Send FAILED: 1744595974957359  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:__default__ operation = Add family = erm-vpn hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2025-04-14 Mon 01:59:34:957.520 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149846976256, Pid 1]: SANDESH: Send FAILED: 1744595974957384  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:__default__ operation = Add family = e-vpn hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2025-04-14 Mon 01:59:34:957.531 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149846976256, Pid 1]: SANDESH: Send FAILED: 1744595974957396  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:__default__ operation = Add family = inet-mvpn hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2025-04-14 Mon 01:59:35:663.826 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149846976256, Pid 1]: SANDESH: Send FAILED: 1744595975663655  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:default-virtual-network instance_name = default-domain:default-project:default-virtual-network:default-virtual-network operation =  add_import_rt= [  [ (*_iter24) = target:64512:7999999,  ] ] hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1238
2025-04-14 Mon 01:59:35:663.880 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149846976256, Pid 1]: SANDESH: Send FAILED: 1744595975663693  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:default-virtual-network instance_name = default-domain:default-project:default-virtual-network:default-virtual-network operation = Add family = inet hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2025-04-14 Mon 01:59:35:689.825 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149846976256, Pid 1]: SANDESH: Send FAILED: 1744595975663723  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:default-virtual-network instance_name = default-domain:default-project:default-virtual-network:default-virtual-network operation = Add family = inet6 hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2025-04-14 Mon 01:59:35:689.849 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149846976256, Pid 1]: SANDESH: Send FAILED: 1744595975663743  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:default-virtual-network instance_name = default-domain:default-project:default-virtual-network:default-virtual-network operation = Add family = erm-vpn hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2025-04-14 Mon 01:59:35:689.861 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149846976256, Pid 1]: SANDESH: Send FAILED: 1744595975663765  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:default-virtual-network instance_name = default-domain:default-project:default-virtual-network:default-virtual-network operation = Add family = e-vpn hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2025-04-14 Mon 01:59:35:689.881 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149846976256, Pid 1]: SANDESH: Send FAILED: 1744595975663780  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:default-virtual-network instance_name = default-domain:default-project:default-virtual-network:default-virtual-network operation = Add family = inet-mvpn hostname = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2025-04-14 Mon 01:59:40:140.094 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149732128512, Pid 1]: SANDESH: Send FAILED: 1744595980139659  [SYS_NOTICE]: RoutingInstanceStats: data= [ name = default-domain:default-project:__link_local__ raw_ipv4_stats= [  [ _iter64->first = default-domain:default-project:__link_local__:__link_local__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_ipv6_stats= [  [ _iter65->first = default-domain:default-project:__link_local__:__link_local__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_evpn_stats= [  [ _iter69->first = default-domain:default-project:__link_local__:__link_local__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_ermvpn_stats= [  [ _iter70->first = default-domain:default-project:__link_local__:__link_local__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_mvpn_stats= [  [ _iter71->first = default-domain:default-project:__link_local__:__link_local__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] ]
2025-04-14 Mon 01:59:40:140.174 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149732128512, Pid 1]: SANDESH: Send FAILED: 1744595980139683  [SYS_NOTICE]: RoutingInstanceStats: data= [ name = default-domain:default-project:dci-network raw_ipv4_stats= [  [ _iter64->first = default-domain:default-project:dci-network:__default__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_ipv6_stats= [  [ _iter65->first = default-domain:default-project:dci-network:__default__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_evpn_stats= [  [ _iter69->first = default-domain:default-project:dci-network:__default__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_ermvpn_stats= [  [ _iter70->first = default-domain:default-project:dci-network:__default__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_mvpn_stats= [  [ _iter71->first = default-domain:default-project:dci-network:__default__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] ]
2025-04-14 Mon 01:59:40:140.217 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149732128512, Pid 1]: SANDESH: Send FAILED: 1744595980139702  [SYS_NOTICE]: RoutingInstanceStats: data= [ name = default-domain:default-project:dci-network raw_ipv4_stats= [  [ _iter64->first = default-domain:default-project:dci-network:dci-network [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_ipv6_stats= [  [ _iter65->first = default-domain:default-project:dci-network:dci-network [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_evpn_stats= [  [ _iter69->first = default-domain:default-project:dci-network:dci-network [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_ermvpn_stats= [  [ _iter70->first = default-domain:default-project:dci-network:dci-network [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_mvpn_stats= [  [ _iter71->first = default-domain:default-project:dci-network:dci-network [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] ]
2025-04-14 Mon 01:59:40:140.253 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149732128512, Pid 1]: SANDESH: Send FAILED: 1744595980139713  [SYS_NOTICE]: RoutingInstanceStats: data= [ name = default-domain:default-project:default-virtual-network raw_ipv4_stats= [  [ _iter64->first = default-domain:default-project:default-virtual-network:default-virtual-network [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_ipv6_stats= [  [ _iter65->first = default-domain:default-project:default-virtual-network:default-virtual-network [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_evpn_stats= [  [ _iter69->first = default-domain:default-project:default-virtual-network:default-virtual-network [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_ermvpn_stats= [  [ _iter70->first = default-domain:default-project:default-virtual-network:default-virtual-network [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_mvpn_stats= [  [ _iter71->first = default-domain:default-project:default-virtual-network:default-virtual-network [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] ]
2025-04-14 Mon 01:59:40:140.301 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149732128512, Pid 1]: SANDESH: Send FAILED: 1744595980139734  [SYS_NOTICE]: RoutingInstanceStats: data= [ name = default-domain:default-project:ip-fabric raw_ipv4_stats= [  [ _iter64->first = default-domain:default-project:ip-fabric:__default__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_ipv6_stats= [  [ _iter65->first = default-domain:default-project:ip-fabric:__default__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_inetvpn_stats= [  [ _iter66->first = default-domain:default-project:ip-fabric:__default__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_inet6vpn_stats= [  [ _iter67->first = default-domain:default-project:ip-fabric:__default__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_rtarget_stats= [  [ _iter68->first = default-domain:default-project:ip-fabric:__default__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_evpn_stats= [  [ _iter69->first = default-domain:default-project:ip-fabric:__default__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_ermvpn_stats= [  [ _iter70->first = default-domain:default-project:ip-fabric:__default__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_mvpn_stats= [  [ _iter71->first = default-domain:default-project:ip-fabric:__default__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] ]
2025-04-14 Mon 01:59:40:140.340 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149732128512, Pid 1]: SANDESH: Send FAILED: 1744595980139745  [SYS_NOTICE]: RoutingInstanceStats: data= [ name = default-domain:default-project:ip-fabric raw_ipv4_stats= [  [ _iter64->first = default-domain:default-project:ip-fabric:ip-fabric [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_ipv6_stats= [  [ _iter65->first = default-domain:default-project:ip-fabric:ip-fabric [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_evpn_stats= [  [ _iter69->first = default-domain:default-project:ip-fabric:ip-fabric [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_ermvpn_stats= [  [ _iter70->first = default-domain:default-project:ip-fabric:ip-fabric [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_mvpn_stats= [  [ _iter71->first = default-domain:default-project:ip-fabric:ip-fabric [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] ]
2025-04-14 Mon 01:59:40:140.395 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149732128512, Pid 1]: SANDESH: Send FAILED: 1744595980139827  [SYS_NOTICE]: BGPRouterInfo: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local router_id = 0.0.0.0 local_asn = 0 global_asn = 0 admin_down = 0 uptime = 1744595980139606 output_queue_depth = 0 num_bgp_peer = 0 num_up_bgp_peer = 0 num_deleting_bgp_peer = 0 num_bgpaas_peer = 0 num_up_bgpaas_peer = 0 num_deleting_bgpaas_peer = 0 num_xmpp_peer = 0 num_up_xmpp_peer = 0 num_deleting_xmpp_peer = 0 num_routing_instance = 6 num_deleted_routing_instance = 0 num_service_chains = 0 num_down_service_chains = 0 num_static_routes = 0 num_down_static_routes = 0 build_info = {"build-info":[{"build-version":"nightly","build-time":"2025-04-14 00:50:12.113130","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-8649-1.novalocal","build-id":"unknown","build-number":"unknown"}]} bgp_router_ip_list= [  [ (*_iter24) = 10.0.0.129,  ] ] bgp_config_peer_list= [  [ ] ] bgp_oper_peer_list= [  [ ] ] ifmap_server_info= [  num_peer_clients = 0 ] db_conn_info= [  cluster = 10.0.0.129 connection_status = 1 connection_status_change_at = 2025-Apr-14 01:59:26.645401 ] amqp_conn_info= [  url = amqp://********:********@10.0.0.129:5673 connection_status = 1 connection_status_change_at = 2025-Apr-14 01:59:05.340575 ] ]
2025-04-14 Mon 01:59:40:151.560 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149740525312, Pid 1]: SANDESH: Send FAILED: 1744595980151343  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local:Control:contrail-control:0 sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvIdleHoldTimerExpired enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 71 dequeues = 71 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 90 dequeues = 90 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1744595951168496 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1744595980140348 ] max_sm_queue_count = 7 ]
2025-04-14 Mon 01:59:40:151.881 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149740525312, Pid 1]: SANDESH: Send FAILED: 1744595980151477  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local:Control:contrail-control:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8083 start_time = 1744595920138888 collector_name =  collector_ip = 10.0.0.129:8086 collector_list= [  [ (*_iter40) = 10.0.0.129:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = BGPRouterInfo [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = BgpConfigInstanceCreateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = BgpConfigInstanceUpdateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigCassInitErrorMessage [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 186 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapLinkOperation [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapNodeOperation [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 31 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceCollector [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceCreateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceStats [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceTableCreateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceUpdateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RprTableJoinLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 35 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 337,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 71,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-04-14 Mon 01:59:41:188.187 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149736326912, Pid 1]: SANDESH: Send FAILED: 1744595981185491  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.129:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name = Cassandra server_addrs= [  [ (*_iter6) = 10.0.0.129:9041,  ] ] status = Up description = Established Cassandra connection ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.129:5673,  ] ] status = Up description = RabbitMQ connection established ],  ] ] flag_infos= [  [ ] ] description = Collector connection down, No BGP configuration for self ],  ] ] ]
2025-04-14 Mon 01:59:41:202.557 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149736326912, Pid 1]: SANDESH: Send FAILED: 1744595981188136  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local:Control:contrail-control:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8083 start_time = 1744595920138888 collector_name =  collector_ip = 10.0.0.129:8086 collector_list= [  [ (*_iter40) = 10.0.0.129:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = BGPRouterInfo [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = BgpConfigInstanceCreateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = BgpConfigInstanceUpdateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigCassInitErrorMessage [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 188 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapLinkOperation [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 22 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapNodeOperation [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 32 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceCollector [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceCreateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceStats [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceTableCreateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceUpdateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RprTableJoinLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 35 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 341,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 73,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-04-14 Mon 01:59:41:202.823 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149736326912, Pid 1]: SANDESH: Send FAILED: 1744595981202664  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.129:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name = Cassandra server_addrs= [  [ (*_iter6) = 10.0.0.129:9041,  ] ] status = Up description = Established Cassandra connection ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.129:5673,  ] ] status = Up description = RabbitMQ connection established ],  ] ] flag_infos= [  [ ] ] description = Collector connection down, No BGP configuration for self ],  ] ] ]
2025-04-14 Mon 01:59:41:203.084 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149736326912, Pid 1]: SANDESH: Send FAILED: 1744595981202788  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-159-1.cluster.local:Control:contrail-control:0 client_info= [  status = ClientInit successful_connections = 1 pid = 1 http_port = 8083 start_time = 1744595920138888 collector_name =  collector_ip = 10.0.0.129:8086 collector_list= [  [ (*_iter40) = 10.0.0.129:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = BGPRouterInfo [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = BgpConfigInstanceCreateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = BgpConfigInstanceUpdateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigCassInitErrorMessage [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 188 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapLinkOperation [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 22 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapNodeOperation [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 32 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceCollector [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceCreateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceStats [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceTableCreateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceUpdateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RprTableJoinLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 35 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 342,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 75,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-04-14 Mon 02:00:54:750.240 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149727930112, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: physical_role Link name is empty node_profile 3a72a4c5-9d14-4535-b291-0b2d94e3fa1d controller/src/ifmap/client/config_json_parser.cc 217
2025-04-14 Mon 02:00:54:893.247 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149838579456, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile 3a72a4c5-9d14-4535-b291-0b2d94e3fa1d controller/src/ifmap/client/config_json_parser.cc 217
2025-04-14 Mon 02:00:55:040.159 UTC  cn-jenkins-deploy-platform-k8s-manifests-159-1 [Thread 140149846976256, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile fae169c0-0675-4c09-997e-116d6bd01b8e controller/src/ifmap/client/config_json_parser.cc 217