2024-11-07 Thu 02:02:08:166.087 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138394159232, Pid 1]: SANDESH: No Client: 1730944928165955  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:Control:contrail-control:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8083 start_time = 1730944928165879 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 0,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-11-07 Thu 02:02:08:168.652 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138240485120, Pid 1]: SANDESH: Send FAILED: 1730944928166810  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Idle : EvStart -> Disconnect ],  ] ] flag_infos= [  [ ] ] description = Number of connections:1, Expected:3 Missing: Database:Cassandra,Database:RabbitMQ, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2024-11-07 Thu 02:02:08:168.763 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138240485120, Pid 1]: SANDESH: Send FAILED: 1730944928168158  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:Control:contrail-control:0 client_info= [  status = Disconnect successful_connections = 0 pid = 1 http_port = 8083 start_time = 1730944928165879 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-11-07 Thu 02:02:08:168.851 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138240485120, Pid 1]: SANDESH: Send FAILED: 1730944928168240  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:Control:contrail-control:0 client_info= [  status = Disconnect successful_connections = 0 pid = 1 http_port = 8083 start_time = 1730944928165879 collector_name =  collector_ip = 10.0.0.29:8086 collector_list= [  [ (*_iter40) = 10.0.0.29:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-11-07 Thu 02:02:08:168.875 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138240485120, Pid 1]: SANDESH: Send FAILED: 1730944928168282  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.29:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  ] ] flag_infos= [  [ ] ] description = Number of connections:1, Expected:3 Missing: Database:Cassandra,Database:RabbitMQ, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2024-11-07 Thu 02:02:08:168.937 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138240485120, Pid 1]: SANDESH: Send FAILED: 1730944928168620  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:Control:contrail-control:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8083 start_time = 1730944928165879 collector_name =  collector_ip = 10.0.0.29:8086 collector_list= [  [ (*_iter40) = 10.0.0.29:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-11-07 Thu 02:02:08:413.582 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138122295040, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2024-11-07 Thu 02:02:08:413.745 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138122295040, Pid 1]: SANDESH: Send FAILED: 1730944928413547  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  ] ] flag_infos= [  [ ] ] description = Number of connections:1, Expected:3 Missing: Database:Cassandra,Database:RabbitMQ, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2024-11-07 Thu 02:02:08:413.891 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138122295040, Pid 1]: SANDESH: Send FAILED: 1730944928413719  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:Control:contrail-control:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8083 start_time = 1730944928165879 collector_name =  collector_ip = 10.0.0.29:8086 collector_list= [  [ (*_iter40) = 10.0.0.29:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 2,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 5,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-11-07 Thu 02:02:08:414.312 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138122295040, Pid 1]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while connecting to RabbitMQ: 10.0.0.29:5673 : a socket error occurred src/contrail-common/config-client-mgr/config_amqp_client.cc 220
2024-11-07 Thu 02:02:08:414.429 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138130691840, Pid 1]: SANDESH: Send FAILED: 1730944928413942  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.29:5673,  ] ] status = Down description = RabbitMQ connection down ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2024-11-07 Thu 02:02:09:414.603 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138211096320, Pid 1]: SANDESH: Send FAILED: 1730944929413886  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.29:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.29:5673,  ] ] status = Down description = RabbitMQ connection down ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2024-11-07 Thu 02:02:09:414.767 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138211096320, Pid 1]: SANDESH: Send FAILED: 1730944929414558  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:Control:contrail-control:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8083 start_time = 1730944928165879 collector_name =  collector_ip = 10.0.0.29:8086 collector_list= [  [ (*_iter40) = 10.0.0.29:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 6,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 8,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-11-07 Thu 02:02:09:414.878 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138211096320, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2024-11-07 Thu 02:02:09:414.992 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138211096320, Pid 1]: SANDESH: Send FAILED: 1730944929414863  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.29:5673,  ] ] status = Down description = RabbitMQ connection down ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2024-11-07 Thu 02:02:09:415.124 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138211096320, Pid 1]: SANDESH: Send FAILED: 1730944929414952  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:Control:contrail-control:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8083 start_time = 1730944928165879 collector_name =  collector_ip = 10.0.0.29:8086 collector_list= [  [ (*_iter40) = 10.0.0.29:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 7,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-11-07 Thu 02:02:11:415.480 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138236286720, Pid 1]: SANDESH: Send FAILED: 1730944931415042  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.29:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.29:5673,  ] ] status = Down description = RabbitMQ connection down ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2024-11-07 Thu 02:02:11:415.660 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138236286720, Pid 1]: SANDESH: Send FAILED: 1730944931415439  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:Control:contrail-control:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8083 start_time = 1730944928165879 collector_name =  collector_ip = 10.0.0.29:8086 collector_list= [  [ (*_iter40) = 10.0.0.29:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 7,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 12,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-11-07 Thu 02:02:11:415.789 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138219493120, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2024-11-07 Thu 02:02:11:415.898 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138219493120, Pid 1]: SANDESH: Send FAILED: 1730944931415768  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.29:5673,  ] ] status = Down description = RabbitMQ connection down ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2024-11-07 Thu 02:02:11:416.029 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138219493120, Pid 1]: SANDESH: Send FAILED: 1730944931415875  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:Control:contrail-control:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8083 start_time = 1730944928165879 collector_name =  collector_ip = 10.0.0.29:8086 collector_list= [  [ (*_iter40) = 10.0.0.29:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 8,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 14,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-11-07 Thu 02:02:13:415.573 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138122295040, Pid 1]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while connecting to RabbitMQ: 10.0.0.29:5673 : a socket error occurred src/contrail-common/config-client-mgr/config_amqp_client.cc 220
2024-11-07 Thu 02:02:15:272.456 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: SANDESH: Send FAILED: 1730944935272284  [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 state_info= [  state = Idle last_state = Idle last_state_at = 1730944935272254 ] ]
2024-11-07 Thu 02:02:15:273.402 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138130691840, Pid 1]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 RECV  Mode Server:  PassiveOpen in state: Idle peer ip: 10.0.0.29 (  ) controller/src/xmpp/xmpp_state_machine.cc 1325
2024-11-07 Thu 02:02:15:564.704 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: SANDESH: Send FAILED: 1730944935273249  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.29 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-11-07 Thu 02:02:15:567.478 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: SANDESH: Send FAILED: 1730944935565789  [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 event_info= [  last_event = xmsm::EvStart last_event_at = 1730944935565782 ] ]
2024-11-07 Thu 02:02:15:568.801 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: SANDESH: Send FAILED: 1730944935565798  [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 state_info= [  state = Active last_state = Idle last_state_at = 1730944935565797 ] ]
2024-11-07 Thu 02:02:15:568.870 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: SANDESH: Send FAILED: 1730944935565805  [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 event_info= [  last_event = xmsm::EvTcpPassiveOpen last_event_at = 1730944935565803 ] ]
2024-11-07 Thu 02:02:15:569.662 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: SANDESH: Send FAILED: 1730944935565828  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.29 state = Active event = EvTcpPassiveOpen local_port = 5269 remote_port = 39089 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-11-07 Thu 02:02:15:569.697 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: SANDESH: Send FAILED: 1730944935566745  [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 identifier = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ]
2024-11-07 Thu 02:02:15:569.715 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: SANDESH: Send FAILED: 1730944935566754  [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 event_info= [  last_event = xmsm::EvXmppOpen last_event_at = 1730944935566753 ] ]
2024-11-07 Thu 02:02:15:569.727 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: SANDESH: Send FAILED: 1730944935566792  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.29 state = Active next_state = Established event = EvXmppOpen identifier = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-11-07 Thu 02:02:15:569.740 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: SANDESH: Send FAILED: 1730944935566796  [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 state_info= [  state = Established last_state = Active last_state_at = 1730944935566795 ] ]
2024-11-07 Thu 02:02:15:569.771 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: SANDESH: Send FAILED: 1730944935566887  [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 event_info= [  last_event = xmsm::EvStop last_event_at = 1730944935566886 ] ]
2024-11-07 Thu 02:02:15:569.783 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: SANDESH: Send FAILED: 1730944935566890  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.29 state = Established event = EvStop ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-11-07 Thu 02:02:15:569.795 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: SANDESH: Send FAILED: 1730944935566943  [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 state_info= [  state = Idle last_state = Established last_state_at = 1730944935566926 ] ]
2024-11-07 Thu 02:02:15:569.813 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: SANDESH: Send FAILED: 1730944935566946  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.29 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-11-07 Thu 02:02:15:569.827 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: SANDESH: Send FAILED: 1730944935566948  [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 flap_info= [  flap_count = 1 flap_time = 1730944935566948 ] ]
2024-11-07 Thu 02:02:15:569.838 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: SANDESH: Send FAILED: 1730944935566955  [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 event_info= [  last_event = xmsm::EvStop last_event_at = 1730944935566952 ] ]
2024-11-07 Thu 02:02:15:569.848 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: SANDESH: Send FAILED: 1730944935567022  [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 deleted = 1 ]
2024-11-07 Thu 02:02:15:569.860 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: SANDESH: Send FAILED: 1730944935567032  [SYS_NOTICE]: PeerStatsUve: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 deleted = 1 encoding =  ]
2024-11-07 Thu 02:02:15:569.874 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: SANDESH: Send FAILED: 1730944935567040  [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 event_info= [  last_event = xmsm::EvStop last_event_at = 1730944935567038 ] ]
2024-11-07 Thu 02:02:15:570.203 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: SANDESH: Send FAILED: 1730944935569928  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.29:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.29:5673,  ] ] status = Down description = RabbitMQ connection down ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2024-11-07 Thu 02:02:15:570.509 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: SANDESH: Send FAILED: 1730944935570172  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:Control:contrail-control:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8083 start_time = 1730944928165879 collector_name =  collector_ip = 10.0.0.29:8086 collector_list= [  [ (*_iter40) = 10.0.0.29:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapChannelUnregisterMessage [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapXmppChannelEvent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = PeerStatsUve [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XMPPPeerInfo [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionCreate [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionDelete [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppCreateConnection [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppPeerEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppPeerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppUnconsumedEvent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 30,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 35,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-11-07 Thu 02:02:15:570.785 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138223691520, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2024-11-07 Thu 02:02:15:571.044 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138223691520, Pid 1]: SANDESH: Send FAILED: 1730944935570760  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.29:5673,  ] ] status = Down description = RabbitMQ connection down ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2024-11-07 Thu 02:02:15:571.381 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138223691520, Pid 1]: SANDESH: Send FAILED: 1730944935570984  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:Control:contrail-control:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8083 start_time = 1730944928165879 collector_name =  collector_ip = 10.0.0.29:8086 collector_list= [  [ (*_iter40) = 10.0.0.29:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapChannelUnregisterMessage [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapXmppChannelEvent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = PeerStatsUve [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XMPPPeerInfo [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionCreate [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionDelete [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppCreateConnection [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppPeerEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppPeerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppUnconsumedEvent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 31,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 37,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-11-07 Thu 02:02:18:562.915 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138122295040, Pid 1]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while connecting to RabbitMQ: 10.0.0.29:5673 : a socket error occurred src/contrail-common/config-client-mgr/config_amqp_client.cc 220
2024-11-07 Thu 02:02:23:572.129 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138240485120, Pid 1]: SANDESH: Send FAILED: 1730944943571822  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.29:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.29:5673,  ] ] status = Down description = RabbitMQ connection down ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2024-11-07 Thu 02:02:23:572.464 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138240485120, Pid 1]: SANDESH: Send FAILED: 1730944943572089  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:Control:contrail-control:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8083 start_time = 1730944928165879 collector_name =  collector_ip = 10.0.0.29:8086 collector_list= [  [ (*_iter40) = 10.0.0.29:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapChannelUnregisterMessage [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapXmppChannelEvent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = PeerStatsUve [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XMPPPeerInfo [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionCreate [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionDelete [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppCreateConnection [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppPeerEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppPeerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppUnconsumedEvent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 32,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 39,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-11-07 Thu 02:02:23:586.410 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138134890240, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2024-11-07 Thu 02:02:23:586.597 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138134890240, Pid 1]: SANDESH: Send FAILED: 1730944943586378  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.29:5673,  ] ] status = Down description = RabbitMQ connection down ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2024-11-07 Thu 02:02:23:586.873 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138134890240, Pid 1]: SANDESH: Send FAILED: 1730944943586564  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:Control:contrail-control:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8083 start_time = 1730944928165879 collector_name =  collector_ip = 10.0.0.29:8086 collector_list= [  [ (*_iter40) = 10.0.0.29:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapChannelUnregisterMessage [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapXmppChannelEvent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = PeerStatsUve [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XMPPPeerInfo [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionCreate [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionDelete [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppCreateConnection [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppPeerEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppPeerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppUnconsumedEvent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 33,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 41,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-11-07 Thu 02:02:24:291.426 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138215294720, Pid 1]: SANDESH: Send FAILED: 1730944944289409  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.29:5673,  ] ] status = Up description = RabbitMQ connection established ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2024-11-07 Thu 02:02:24:291.486 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138215294720, Pid 1]: SANDESH: Send FAILED: 1730944944289470  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name = Cassandra server_addrs= [  [ (*_iter6) = 10.0.0.29:9041,  ] ] status = Down description = Lost Cassandra connection ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.29:5673,  ] ] status = Up description = RabbitMQ connection established ],  ] ] flag_infos= [  [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2024-11-07 Thu 02:02:38:188.429 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138211096320, Pid 1]: SANDESH: Send FAILED: 1730944958182949  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:Control:contrail-control:0 sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvIdleHoldTimerExpired enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 45 dequeues = 45 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 61 dequeues = 61 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1730944943586470 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1730944944291473 ] max_sm_queue_count = 17 ]
2024-11-07 Thu 02:02:38:204.821 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138211096320, Pid 1]: SANDESH: Send FAILED: 1730944958183081  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:Control:contrail-control:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8083 start_time = 1730944928165879 collector_name =  collector_ip = 10.0.0.29:8086 collector_list= [  [ (*_iter40) = 10.0.0.29:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ConfigCassInitErrorMessage [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapChannelUnregisterMessage [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapXmppChannelEvent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = PeerStatsUve [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XMPPPeerInfo [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionCreate [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionDelete [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppCreateConnection [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppPeerEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppPeerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppUnconsumedEvent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 47,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 45,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-11-07 Thu 02:02:39:589.678 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138211096320, Pid 1]: SANDESH: Send FAILED: 1730944959589321  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.29:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name = Cassandra server_addrs= [  [ (*_iter6) = 10.0.0.29:9041,  ] ] status = Down description = Lost Cassandra connection ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.29:5673,  ] ] status = Up description = RabbitMQ connection established ],  ] ] flag_infos= [  [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2024-11-07 Thu 02:02:39:902.166 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138211096320, Pid 1]: SANDESH: Send FAILED: 1730944959589640  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:Control:contrail-control:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8083 start_time = 1730944928165879 collector_name =  collector_ip = 10.0.0.29:8086 collector_list= [  [ (*_iter40) = 10.0.0.29:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ConfigCassInitErrorMessage [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapChannelUnregisterMessage [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapXmppChannelEvent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = PeerStatsUve [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XMPPPeerInfo [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionCreate [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionDelete [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppCreateConnection [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppPeerEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppPeerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppUnconsumedEvent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 48,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 47,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-11-07 Thu 02:02:39:911.719 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138211096320, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2024-11-07 Thu 02:02:39:911.925 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138211096320, Pid 1]: SANDESH: Send FAILED: 1730944959911679  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name = Cassandra server_addrs= [  [ (*_iter6) = 10.0.0.29:9041,  ] ] status = Down description = Lost Cassandra connection ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.29:5673,  ] ] status = Up description = RabbitMQ connection established ],  ] ] flag_infos= [  [ ] ] description = Collector, Database:Cassandra connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2024-11-07 Thu 02:02:39:912.467 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138211096320, Pid 1]: SANDESH: Send FAILED: 1730944959911884  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:Control:contrail-control:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8083 start_time = 1730944928165879 collector_name =  collector_ip = 10.0.0.29:8086 collector_list= [  [ (*_iter40) = 10.0.0.29:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ConfigCassInitErrorMessage [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapChannelUnregisterMessage [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapXmppChannelEvent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = PeerStatsUve [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XMPPPeerInfo [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionCreate [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionDelete [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppCreateConnection [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppPeerEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppPeerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppUnconsumedEvent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 52,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 49,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-11-07 Thu 02:02:46:360.396 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138240485120, Pid 1]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 RECV  Mode Server:  PassiveOpen in state: Idle peer ip: 10.0.0.29 (  ) controller/src/xmpp/xmpp_state_machine.cc 1325
2024-11-07 Thu 02:02:46:360.485 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138240485120, Pid 1]: SANDESH: Send FAILED: 1730944966360355  [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 state_info= [  state = Idle last_state = Idle last_state_at = 1730944966360339 ] ]
2024-11-07 Thu 02:02:46:360.504 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138240485120, Pid 1]: SANDESH: Send FAILED: 1730944966360373  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.29 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-11-07 Thu 02:02:46:360.521 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138240485120, Pid 1]: SANDESH: Send FAILED: 1730944966360443  [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 event_info= [  last_event = xmsm::EvStart last_event_at = 1730944966360441 ] ]
2024-11-07 Thu 02:02:46:360.534 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138240485120, Pid 1]: SANDESH: Send FAILED: 1730944966360448  [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 state_info= [  state = Active last_state = Idle last_state_at = 1730944966360447 ] ]
2024-11-07 Thu 02:02:46:360.545 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138240485120, Pid 1]: SANDESH: Send FAILED: 1730944966360453  [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 event_info= [  last_event = xmsm::EvTcpPassiveOpen last_event_at = 1730944966360452 ] ]
2024-11-07 Thu 02:02:46:360.557 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138240485120, Pid 1]: SANDESH: Send FAILED: 1730944966360468  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.29 state = Active event = EvTcpPassiveOpen local_port = 5269 remote_port = 39353 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-11-07 Thu 02:02:46:418.076 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138134890240, Pid 1]: SANDESH: Send FAILED: 1730944966417880  [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 identifier = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ]
2024-11-07 Thu 02:02:46:418.118 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138134890240, Pid 1]: SANDESH: Send FAILED: 1730944966417901  [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 event_info= [  last_event = xmsm::EvXmppOpen last_event_at = 1730944966417898 ] ]
2024-11-07 Thu 02:02:46:418.133 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138134890240, Pid 1]: SANDESH: Send FAILED: 1730944966417942  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.29 state = Active next_state = Established event = EvXmppOpen identifier = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-11-07 Thu 02:02:46:418.146 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138134890240, Pid 1]: SANDESH: Send FAILED: 1730944966417948  [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 state_info= [  state = Established last_state = Active last_state_at = 1730944966417946 ] ]
2024-11-07 Thu 02:02:46:418.157 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138134890240, Pid 1]: SANDESH: Send FAILED: 1730944966418018  [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 event_info= [  last_event = xmsm::EvStop last_event_at = 1730944966418016 ] ]
2024-11-07 Thu 02:02:46:418.167 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138134890240, Pid 1]: SANDESH: Send FAILED: 1730944966418021  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.29 state = Established event = EvStop ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-11-07 Thu 02:02:46:418.178 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138134890240, Pid 1]: SANDESH: Send FAILED: 1730944966418042  [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 state_info= [  state = Idle last_state = Established last_state_at = 1730944966418041 ] ]
2024-11-07 Thu 02:02:46:418.192 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138134890240, Pid 1]: SANDESH: Send FAILED: 1730944966418045  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.29 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-11-07 Thu 02:02:46:418.204 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138134890240, Pid 1]: SANDESH: Send FAILED: 1730944966418047  [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 flap_info= [  flap_count = 2 flap_time = 1730944966418046 ] ]
2024-11-07 Thu 02:02:46:418.215 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138134890240, Pid 1]: SANDESH: Send FAILED: 1730944966418052  [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 event_info= [  last_event = xmsm::EvStop last_event_at = 1730944966418051 ] ]
2024-11-07 Thu 02:02:46:418.316 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138134890240, Pid 1]: SANDESH: Send FAILED: 1730944966418275  [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 deleted = 1 ]
2024-11-07 Thu 02:02:46:418.333 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138134890240, Pid 1]: SANDESH: Send FAILED: 1730944966418282  [SYS_NOTICE]: PeerStatsUve: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 deleted = 1 encoding =  ]
2024-11-07 Thu 02:02:46:418.358 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138134890240, Pid 1]: SANDESH: Send FAILED: 1730944966418290  [SYS_NOTICE]: XMPPPeerInfo: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 event_info= [  last_event = xmsm::EvStop last_event_at = 1730944966418287 ] ]
2024-11-07 Thu 02:02:55:011.396 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138139088640, Pid 1]: SANDESH: Send FAILED: 1730944975011262  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name = Cassandra server_addrs= [  [ (*_iter6) = 10.0.0.29:9041,  ] ] status = Up description = Established Cassandra connection ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.29:5673,  ] ] status = Up description = RabbitMQ connection established ],  ] ] flag_infos= [  [ ] ] description = Collector connection down, IFMap Server End-Of-RIB not computed, No BGP configuration for self ],  ] ] ]
2024-11-07 Thu 02:02:56:836.055 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138223691520, Pid 1]: SANDESH: Send FAILED: 1730944976835988  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name = Cassandra server_addrs= [  [ (*_iter6) = 10.0.0.29:9041,  ] ] status = Up description = Established Cassandra connection ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.29:5673,  ] ] status = Up description = RabbitMQ connection established ],  ] ] flag_infos= [  [ ] ] description = Collector connection down, No BGP configuration for self ],  ] ] ]
2024-11-07 Thu 02:03:01:117.418 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138219493120, Pid 1]: SANDESH: Send FAILED: 1730944981117193  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:ip-fabric operation =  add_import_rt= [  [ (*_iter24) = target:64512:7999999,  ] ] hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1238
2024-11-07 Thu 02:03:01:117.466 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138219493120, Pid 1]: SANDESH: Send FAILED: 1730944981117217  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:ip-fabric operation = Add family = inet hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2024-11-07 Thu 02:03:01:117.479 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138219493120, Pid 1]: SANDESH: Send FAILED: 1730944981117258  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:ip-fabric operation = Add family = inet6 hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2024-11-07 Thu 02:03:01:117.490 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138219493120, Pid 1]: SANDESH: Send FAILED: 1730944981117284  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:ip-fabric operation = Add family = erm-vpn hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2024-11-07 Thu 02:03:01:117.501 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138219493120, Pid 1]: SANDESH: Send FAILED: 1730944981117324  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:ip-fabric operation = Add family = e-vpn hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2024-11-07 Thu 02:03:01:117.510 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138219493120, Pid 1]: SANDESH: Send FAILED: 1730944981117352  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:ip-fabric operation = Add family = inet-mvpn hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2024-11-07 Thu 02:03:01:650.869 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138134890240, Pid 1]: SANDESH: Send FAILED: 1730944981650712  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:__link_local__ instance_name = default-domain:default-project:__link_local__:__link_local__ operation =  add_import_rt= [  [ (*_iter24) = target:64512:7999999,  ] ] hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1238
2024-11-07 Thu 02:03:01:650.913 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138134890240, Pid 1]: SANDESH: Send FAILED: 1730944981650739  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:__link_local__ instance_name = default-domain:default-project:__link_local__:__link_local__ operation = Add family = inet hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2024-11-07 Thu 02:03:01:650.926 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138134890240, Pid 1]: SANDESH: Send FAILED: 1730944981650767  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:__link_local__ instance_name = default-domain:default-project:__link_local__:__link_local__ operation = Add family = inet6 hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2024-11-07 Thu 02:03:01:650.940 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138134890240, Pid 1]: SANDESH: Send FAILED: 1730944981650785  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:__link_local__ instance_name = default-domain:default-project:__link_local__:__link_local__ operation = Add family = erm-vpn hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2024-11-07 Thu 02:03:01:650.951 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138134890240, Pid 1]: SANDESH: Send FAILED: 1730944981650811  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:__link_local__ instance_name = default-domain:default-project:__link_local__:__link_local__ operation = Add family = e-vpn hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2024-11-07 Thu 02:03:01:650.961 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138134890240, Pid 1]: SANDESH: Send FAILED: 1730944981650824  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:__link_local__ instance_name = default-domain:default-project:__link_local__:__link_local__ operation = Add family = inet-mvpn hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2024-11-07 Thu 02:03:02:192.842 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138232088320, Pid 1]: SANDESH: Send FAILED: 1730944982192679  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:dci-network operation =  add_import_rt= [  [ (*_iter24) = target:64512:7999999,  ] ] hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1238
2024-11-07 Thu 02:03:02:192.888 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138232088320, Pid 1]: SANDESH: Send FAILED: 1730944982192702  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:dci-network operation = Add family = inet hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2024-11-07 Thu 02:03:02:192.901 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138232088320, Pid 1]: SANDESH: Send FAILED: 1730944982192730  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:dci-network operation = Add family = inet6 hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2024-11-07 Thu 02:03:02:192.912 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138232088320, Pid 1]: SANDESH: Send FAILED: 1730944982192750  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:dci-network operation = Add family = erm-vpn hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2024-11-07 Thu 02:03:02:192.926 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138232088320, Pid 1]: SANDESH: Send FAILED: 1730944982192773  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:dci-network operation = Add family = e-vpn hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2024-11-07 Thu 02:03:02:192.937 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138232088320, Pid 1]: SANDESH: Send FAILED: 1730944982192786  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:dci-network operation = Add family = inet-mvpn hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2024-11-07 Thu 02:03:02:353.231 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138232088320, Pid 1]: SANDESH: Send FAILED: 1730944982353065  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:__default__ operation =  add_import_rt= [  [ (*_iter24) = target:64512:7999999,  ] ] hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1238
2024-11-07 Thu 02:03:02:353.271 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138232088320, Pid 1]: SANDESH: Send FAILED: 1730944982353086  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:__default__ operation = Add family = inet hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2024-11-07 Thu 02:03:02:353.283 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138232088320, Pid 1]: SANDESH: Send FAILED: 1730944982353114  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:__default__ operation = Add family = inet6 hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2024-11-07 Thu 02:03:02:353.328 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138232088320, Pid 1]: SANDESH: Send FAILED: 1730944982353136  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:__default__ operation = Add family = erm-vpn hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2024-11-07 Thu 02:03:02:353.350 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138232088320, Pid 1]: SANDESH: Send FAILED: 1730944982353158  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:__default__ operation = Add family = e-vpn hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2024-11-07 Thu 02:03:02:353.361 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138232088320, Pid 1]: SANDESH: Send FAILED: 1730944982353183  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:__default__ operation = Add family = inet-mvpn hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2024-11-07 Thu 02:03:02:515.484 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138232088320, Pid 1]: SANDESH: Send FAILED: 1730944982515247  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:default-virtual-network instance_name = default-domain:default-project:default-virtual-network:default-virtual-network operation =  add_import_rt= [  [ (*_iter24) = target:64512:7999999,  ] ] hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1238
2024-11-07 Thu 02:03:02:515.541 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138232088320, Pid 1]: SANDESH: Send FAILED: 1730944982515274  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:default-virtual-network instance_name = default-domain:default-project:default-virtual-network:default-virtual-network operation = Add family = inet hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2024-11-07 Thu 02:03:02:515.559 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138232088320, Pid 1]: SANDESH: Send FAILED: 1730944982515325  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:default-virtual-network instance_name = default-domain:default-project:default-virtual-network:default-virtual-network operation = Add family = inet6 hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2024-11-07 Thu 02:03:02:515.575 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138232088320, Pid 1]: SANDESH: Send FAILED: 1730944982515369  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:default-virtual-network instance_name = default-domain:default-project:default-virtual-network:default-virtual-network operation = Add family = erm-vpn hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2024-11-07 Thu 02:03:02:515.592 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138232088320, Pid 1]: SANDESH: Send FAILED: 1730944982515401  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:default-virtual-network instance_name = default-domain:default-project:default-virtual-network:default-virtual-network operation = Add family = e-vpn hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2024-11-07 Thu 02:03:02:515.608 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138232088320, Pid 1]: SANDESH: Send FAILED: 1730944982515421  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:default-virtual-network instance_name = default-domain:default-project:default-virtual-network:default-virtual-network operation = Add family = inet-mvpn hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1718
2024-11-07 Thu 02:03:08:183.603 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138211096320, Pid 1]: SANDESH: Send FAILED: 1730944988183408  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:Control:contrail-control:0 sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvIdleHoldTimerExpired enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 102 dequeues = 102 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 121 dequeues = 121 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1730944959911780 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1730944982515600 ] max_sm_queue_count = 17 ]
2024-11-07 Thu 02:03:08:184.007 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138211096320, Pid 1]: SANDESH: Send FAILED: 1730944988183522  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:Control:contrail-control:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8083 start_time = 1730944928165879 collector_name =  collector_ip = 10.0.0.29:8086 collector_list= [  [ (*_iter40) = 10.0.0.29:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = BgpConfigInstanceCreateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = BgpConfigInstanceUpdateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigCassInitErrorMessage [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 219 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapChannelUnregisterMessage [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapLinkOperation [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 47 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapNodeOperation [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 55 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapXmppChannelEvent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = PeerStatsUve [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceCollector [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceCreateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceTableCreateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceUpdateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RprTableJoinLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 35 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XMPPPeerInfo [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 26 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionCreate [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionDelete [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppCreateConnection [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppPeerEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppPeerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppUnconsumedEvent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 463,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 102,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-11-07 Thu 02:03:08:421.252 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138236286720, Pid 1]: SANDESH: Send FAILED: 1730944988413741  [SYS_NOTICE]: RoutingInstanceStats: data= [ name = default-domain:default-project:__link_local__ raw_ipv4_stats= [  [ _iter64->first = default-domain:default-project:__link_local__:__link_local__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_ipv6_stats= [  [ _iter65->first = default-domain:default-project:__link_local__:__link_local__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_evpn_stats= [  [ _iter69->first = default-domain:default-project:__link_local__:__link_local__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_ermvpn_stats= [  [ _iter70->first = default-domain:default-project:__link_local__:__link_local__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_mvpn_stats= [  [ _iter71->first = default-domain:default-project:__link_local__:__link_local__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] ]
2024-11-07 Thu 02:03:08:421.374 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138236286720, Pid 1]: SANDESH: Send FAILED: 1730944988413764  [SYS_NOTICE]: RoutingInstanceStats: data= [ name = default-domain:default-project:dci-network raw_ipv4_stats= [  [ _iter64->first = default-domain:default-project:dci-network:__default__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_ipv6_stats= [  [ _iter65->first = default-domain:default-project:dci-network:__default__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_evpn_stats= [  [ _iter69->first = default-domain:default-project:dci-network:__default__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_ermvpn_stats= [  [ _iter70->first = default-domain:default-project:dci-network:__default__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_mvpn_stats= [  [ _iter71->first = default-domain:default-project:dci-network:__default__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] ]
2024-11-07 Thu 02:03:08:421.430 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138236286720, Pid 1]: SANDESH: Send FAILED: 1730944988413770  [SYS_NOTICE]: RoutingInstanceStats: data= [ name = default-domain:default-project:dci-network raw_ipv4_stats= [  [ _iter64->first = default-domain:default-project:dci-network:dci-network [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_ipv6_stats= [  [ _iter65->first = default-domain:default-project:dci-network:dci-network [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_evpn_stats= [  [ _iter69->first = default-domain:default-project:dci-network:dci-network [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_ermvpn_stats= [  [ _iter70->first = default-domain:default-project:dci-network:dci-network [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_mvpn_stats= [  [ _iter71->first = default-domain:default-project:dci-network:dci-network [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] ]
2024-11-07 Thu 02:03:08:421.488 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138236286720, Pid 1]: SANDESH: Send FAILED: 1730944988413778  [SYS_NOTICE]: RoutingInstanceStats: data= [ name = default-domain:default-project:default-virtual-network raw_ipv4_stats= [  [ _iter64->first = default-domain:default-project:default-virtual-network:default-virtual-network [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_ipv6_stats= [  [ _iter65->first = default-domain:default-project:default-virtual-network:default-virtual-network [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_evpn_stats= [  [ _iter69->first = default-domain:default-project:default-virtual-network:default-virtual-network [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_ermvpn_stats= [  [ _iter70->first = default-domain:default-project:default-virtual-network:default-virtual-network [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_mvpn_stats= [  [ _iter71->first = default-domain:default-project:default-virtual-network:default-virtual-network [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] ]
2024-11-07 Thu 02:03:08:421.563 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138236286720, Pid 1]: SANDESH: Send FAILED: 1730944988413791  [SYS_NOTICE]: RoutingInstanceStats: data= [ name = default-domain:default-project:ip-fabric raw_ipv4_stats= [  [ _iter64->first = default-domain:default-project:ip-fabric:__default__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_ipv6_stats= [  [ _iter65->first = default-domain:default-project:ip-fabric:__default__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_inetvpn_stats= [  [ _iter66->first = default-domain:default-project:ip-fabric:__default__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_inet6vpn_stats= [  [ _iter67->first = default-domain:default-project:ip-fabric:__default__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_rtarget_stats= [  [ _iter68->first = default-domain:default-project:ip-fabric:__default__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_evpn_stats= [  [ _iter69->first = default-domain:default-project:ip-fabric:__default__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_ermvpn_stats= [  [ _iter70->first = default-domain:default-project:ip-fabric:__default__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_mvpn_stats= [  [ _iter71->first = default-domain:default-project:ip-fabric:__default__ [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] ]
2024-11-07 Thu 02:03:08:421.611 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138236286720, Pid 1]: SANDESH: Send FAILED: 1730944988413797  [SYS_NOTICE]: RoutingInstanceStats: data= [ name = default-domain:default-project:ip-fabric raw_ipv4_stats= [  [ _iter64->first = default-domain:default-project:ip-fabric:ip-fabric [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_ipv6_stats= [  [ _iter65->first = default-domain:default-project:ip-fabric:ip-fabric [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_evpn_stats= [  [ _iter69->first = default-domain:default-project:ip-fabric:ip-fabric [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_ermvpn_stats= [  [ _iter70->first = default-domain:default-project:ip-fabric:ip-fabric [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] raw_mvpn_stats= [  [ _iter71->first = default-domain:default-project:ip-fabric:ip-fabric [   prefixes = 0 primary_paths = 0 secondary_paths = 0 infeasible_paths = 0 total_paths = 0 ],  ] ] ]
2024-11-07 Thu 02:03:08:421.664 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138236286720, Pid 1]: SANDESH: Send FAILED: 1730944988413873  [SYS_NOTICE]: BGPRouterInfo: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local router_id = 0.0.0.0 local_asn = 0 global_asn = 0 admin_down = 0 uptime = 1730944988413693 output_queue_depth = 0 num_bgp_peer = 0 num_up_bgp_peer = 0 num_deleting_bgp_peer = 0 num_bgpaas_peer = 0 num_up_bgpaas_peer = 0 num_deleting_bgpaas_peer = 0 num_xmpp_peer = 0 num_up_xmpp_peer = 0 num_deleting_xmpp_peer = 0 num_routing_instance = 6 num_deleted_routing_instance = 0 num_service_chains = 0 num_down_service_chains = 0 num_static_routes = 0 num_down_static_routes = 0 build_info = {"build-info":[{"build-version":"nightly","build-time":"2024-11-07 00:42:34.371471","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-6377-1.novalocal","build-id":"nightly-nightly.el7","build-number":"@contrail"}]} bgp_router_ip_list= [  [ (*_iter24) = 10.0.0.29,  ] ] bgp_config_peer_list= [  [ ] ] bgp_oper_peer_list= [  [ ] ] ifmap_server_info= [  num_peer_clients = 0 ] db_conn_info= [  cluster = 10.0.0.29 connection_status = 1 connection_status_change_at = 2024-Nov-07 02:02:55.011227 ] amqp_conn_info= [  url = amqp://********:********@10.0.0.29:5673 connection_status = 1 connection_status_change_at = 2024-Nov-07 02:02:24.289443 ] ]
2024-11-07 Thu 02:03:09:236.779 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: SANDESH: Send FAILED: 1730944989236724  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name = Cassandra server_addrs= [  [ (*_iter6) = 10.0.0.29:9041,  ] ] status = Up description = Established Cassandra connection ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.29:5673,  ] ] status = Up description = RabbitMQ connection established ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2024-11-07 Thu 02:03:09:237.020 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: SANDESH: Send FAILED: 1730944989236874  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:__default__ route_distinguisher = 10.0.0.29:4 operation =  add_import_rt= [  [ (*_iter24) = target:10.0.0.29:4,  ] ] hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1390
2024-11-07 Thu 02:03:09:237.037 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: SANDESH: Send FAILED: 1730944989236923  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:ip-fabric instance_name = default-domain:default-project:ip-fabric:ip-fabric route_distinguisher = 10.0.0.29:1 operation =  add_import_rt= [  [ (*_iter24) = target:10.0.0.29:1,  ] ] hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1390
2024-11-07 Thu 02:03:09:237.049 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: SANDESH: Send FAILED: 1730944989236963  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:dci-network instance_name = default-domain:default-project:dci-network:dci-network route_distinguisher = 10.0.0.29:3 operation =  add_import_rt= [  [ (*_iter24) = target:10.0.0.29:3,  ] ] hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1390
2024-11-07 Thu 02:03:09:237.059 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: SANDESH: Send FAILED: 1730944989237002  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:default-virtual-network instance_name = default-domain:default-project:default-virtual-network:default-virtual-network route_distinguisher = 10.0.0.29:5 operation =  add_import_rt= [  [ (*_iter24) = target:10.0.0.29:5,  ] ] hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1390
2024-11-07 Thu 02:03:09:237.128 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: SANDESH: Send FAILED: 1730944989237101  [SYS_INFO]: RoutingInstanceCollector: routing_instance= [ name = default-domain:default-project:__link_local__ instance_name = default-domain:default-project:__link_local__:__link_local__ route_distinguisher = 10.0.0.29:2 operation =  add_import_rt= [  [ (*_iter24) = target:10.0.0.29:2,  ] ] hostname = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local ] file = controller/src/bgp/routing-instance/routing_instance.cc line = 1390
2024-11-07 Thu 02:03:09:925.006 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138223691520, Pid 1]: SANDESH: Send FAILED: 1730944989912467  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.29:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name = Cassandra server_addrs= [  [ (*_iter6) = 10.0.0.29:9041,  ] ] status = Up description = Established Cassandra connection ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.29:5673,  ] ] status = Up description = RabbitMQ connection established ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2024-11-07 Thu 02:03:09:925.731 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138223691520, Pid 1]: SANDESH: Send FAILED: 1730944989924951  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:Control:contrail-control:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8083 start_time = 1730944928165879 collector_name =  collector_ip = 10.0.0.29:8086 collector_list= [  [ (*_iter40) = 10.0.0.29:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = BGPRouterInfo [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = BgpConfigInstanceCreateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = BgpConfigInstanceUpdateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = BgpConfigLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = BgpConfigProtocolUpdateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigCassInitErrorMessage [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 239 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapChannelUnregisterMessage [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapLinkOperation [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapNodeOperation [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 74 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapXmppChannelEvent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = PeerStatsUve [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceCollector [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 35 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceCreateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceStats [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceTableCreateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceUpdateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RprTableJoinLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 110 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XMPPPeerInfo [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 26 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionCreate [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionDelete [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppCreateConnection [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppPeerEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppPeerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppUnconsumedEvent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 616,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 117,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-11-07 Thu 02:03:09:925.779 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138223691520, Pid 1]: SANDESH: Send FAILED: 1730944989925068  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local process_status= [  [ [  module_id = contrail-control instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.29:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name = Cassandra server_addrs= [  [ (*_iter6) = 10.0.0.29:9041,  ] ] status = Up description = Established Cassandra connection ],  [  type = Database name = RabbitMQ server_addrs= [  [ (*_iter6) = 10.0.0.29:5673,  ] ] status = Up description = RabbitMQ connection established ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2024-11-07 Thu 02:03:09:926.168 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138223691520, Pid 1]: SANDESH: Send FAILED: 1730944989925271  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:Control:contrail-control:0 client_info= [  status = ClientInit successful_connections = 1 pid = 1 http_port = 8083 start_time = 1730944928165879 collector_name =  collector_ip = 10.0.0.29:8086 collector_list= [  [ (*_iter40) = 10.0.0.29:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = BGPRouterInfo [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = BgpConfigInstanceCreateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = BgpConfigInstanceUpdateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = BgpConfigLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = BgpConfigProtocolUpdateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigCassInitErrorMessage [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrDebug [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 239 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = ConfigClientMgrWarning [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapChannelUnregisterMessage [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapLinkOperation [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapNodeOperation [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 74 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = IFMapXmppChannelEvent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = PeerStatsUve [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceCollector [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 35 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceCreateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceStats [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceTableCreateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RoutingInstanceUpdateLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = RprTableJoinLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 110 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XMPPPeerInfo [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 26 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionCreate [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionDelete [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppCreateConnection [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppPeerEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppPeerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppUnconsumedEvent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 616,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 118,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-11-07 Thu 02:03:16:137.816 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138126493440, Pid 1]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29 RECV  Mode Server:  PassiveOpen in state: Idle peer ip: 10.0.0.29 (  ) controller/src/xmpp/xmpp_state_machine.cc 1325
2024-11-07 Thu 02:03:16:277.312 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138236286720, Pid 1]: BGP [SYS_WARN]: XmppPeerInstanceLog: XMPP Peer cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29  in instance default-domain:default-project:ip-fabric:__default__ : Bad label -1 for inet route 10.0.0.0/24 controller/src/bgp/bgp_xmpp_channel.cc 1242
2024-11-07 Thu 02:03:16:278.487 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138236286720, Pid 1]: BGP [SYS_WARN]: XmppPeerInstanceLog: XMPP Peer cn-jenkins-deploy-platform-k8s-manifests-107-1.cluster.local:10.0.0.29  in instance default-domain:default-project:ip-fabric:__default__ : Bad label -1 for inet route 10.0.0.0/24 controller/src/bgp/bgp_xmpp_channel.cc 1242
2024-11-07 Thu 02:04:10:339.274 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138232088320, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: physical_role Link name is empty node_profile 6393bba0-0924-4adf-8d2c-677caaeee2c9 controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:04:10:481.005 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138211096320, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile 6393bba0-0924-4adf-8d2c-677caaeee2c9 controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:04:10:623.248 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138139088640, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile b2037fd1-3149-483b-aa26-03d460dd3b8e controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:05:50:833.846 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: physical_role Link name is empty node_profile 6393bba0-0924-4adf-8d2c-677caaeee2c9 controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:05:50:989.962 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138130691840, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile 6393bba0-0924-4adf-8d2c-677caaeee2c9 controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:05:51:195.264 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile b2037fd1-3149-483b-aa26-03d460dd3b8e controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:06:23:200.584 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138139088640, Pid 1]: IFMap [SYS_WARN]: IFMapIdentifierNotFound: Cant find identifier target:64512:8000007 controller/src/ifmap/ifmap_server_table.cc 257
2024-11-07 Thu 02:07:36:225.891 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138130691840, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: physical_role Link name is empty node_profile 6393bba0-0924-4adf-8d2c-677caaeee2c9 controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:07:36:366.808 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138215294720, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile 6393bba0-0924-4adf-8d2c-677caaeee2c9 controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:07:36:507.352 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138219493120, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile b2037fd1-3149-483b-aa26-03d460dd3b8e controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:09:22:679.605 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138139088640, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: physical_role Link name is empty node_profile 6393bba0-0924-4adf-8d2c-677caaeee2c9 controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:09:22:820.464 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138126493440, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile 6393bba0-0924-4adf-8d2c-677caaeee2c9 controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:09:22:963.237 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138130691840, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile b2037fd1-3149-483b-aa26-03d460dd3b8e controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:11:32:923.324 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138236286720, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: physical_role Link name is empty node_profile 6393bba0-0924-4adf-8d2c-677caaeee2c9 controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:11:33:071.474 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138215294720, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile 6393bba0-0924-4adf-8d2c-677caaeee2c9 controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:11:33:222.181 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138139088640, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile b2037fd1-3149-483b-aa26-03d460dd3b8e controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:14:14:532.655 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: physical_role Link name is empty node_profile 6393bba0-0924-4adf-8d2c-677caaeee2c9 controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:14:14:674.416 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138236286720, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile 6393bba0-0924-4adf-8d2c-677caaeee2c9 controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:14:14:825.833 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138134890240, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile b2037fd1-3149-483b-aa26-03d460dd3b8e controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:18:02:036.027 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138223691520, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: physical_role Link name is empty node_profile 6393bba0-0924-4adf-8d2c-677caaeee2c9 controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:18:02:181.884 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138215294720, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile 6393bba0-0924-4adf-8d2c-677caaeee2c9 controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:18:02:339.201 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138223691520, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile b2037fd1-3149-483b-aa26-03d460dd3b8e controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:24:33:150.871 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138139088640, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: physical_role Link name is empty node_profile 6393bba0-0924-4adf-8d2c-677caaeee2c9 controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:24:33:292.236 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138227889920, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile 6393bba0-0924-4adf-8d2c-677caaeee2c9 controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:24:33:434.079 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138130691840, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile b2037fd1-3149-483b-aa26-03d460dd3b8e controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:30:49:954.374 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138126493440, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: physical_role Link name is empty node_profile 6393bba0-0924-4adf-8d2c-677caaeee2c9 controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:30:50:095.973 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138240485120, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile 6393bba0-0924-4adf-8d2c-677caaeee2c9 controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:30:50:239.012 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138211096320, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile b2037fd1-3149-483b-aa26-03d460dd3b8e controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:36:58:451.142 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138236286720, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: physical_role Link name is empty node_profile 6393bba0-0924-4adf-8d2c-677caaeee2c9 controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:36:58:615.893 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138219493120, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile 6393bba0-0924-4adf-8d2c-677caaeee2c9 controller/src/ifmap/client/config_json_parser.cc 217
2024-11-07 Thu 02:36:58:756.469 UTC  cn-jenkins-deploy-platform-k8s-manifests-107-1 [Thread 140138232088320, Pid 1]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile b2037fd1-3149-483b-aa26-03d460dd3b8e controller/src/ifmap/client/config_json_parser.cc 217