2024-12-23 Mon 01:40:04:792.042 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741407033088, Pid 809]: KsyncTxQueue CPU pinning policy <>. KsyncTxQueuen not pinned to CPU
2024-12-23 Mon 01:40:04:925.884 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741415429888, Pid 809]: SANDESH: No Client: 1734918004925805  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Idle successful_connections = 0 pid = 809 http_port = 8085 start_time = 1734918004925713 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 0,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-12-23 Mon 01:40:04:926.416 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741398636288, Pid 809]: SANDESH: Send FAILED: 1734918004926045  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Idle : EvStart -> Disconnect ],  ] ] flag_infos= [  [ ] ] description = Collector connection down, No Configuration for self Number of connections:1, Expected: 3 ],  ] ] ]
2024-12-23 Mon 01:40:04:926.460 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741398636288, Pid 809]: SANDESH: Send FAILED: 1734918004926056 AgentVrf [SYS_INFO]: VrfObjectLog: vrf= [ event = Addition  name = default-domain:default-project:ip-fabric:__default__ index = 0 ] file = controller/src/vnsw/agent/oper/vrf.cc line = 414
2024-12-23 Mon 01:40:04:926.479 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741398636288, Pid 809]: SANDESH: Send FAILED: 1734918004926108 AgentVrf [SYS_INFO]: VrfObjectLog: vrf= [ event = Addition  name = default-domain:default-project:ip-fabric:ip-fabric index = 1 ] file = controller/src/vnsw/agent/oper/vrf.cc line = 414
2024-12-23 Mon 01:40:04:926.580 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741398636288, Pid 809]: SANDESH: Send FAILED: 1734918004926141  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Disconnect successful_connections = 0 pid = 809 http_port = 8085 start_time = 1734918004925713 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-12-23 Mon 01:40:04:926.657 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741398636288, Pid 809]: SANDESH: Send FAILED: 1734918004926175  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Disconnect successful_connections = 0 pid = 809 http_port = 8085 start_time = 1734918004925713 collector_name =  collector_ip = 10.0.0.30:8086 collector_list= [  [ (*_iter40) = 10.0.0.30:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-12-23 Mon 01:40:04:926.681 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741398636288, Pid 809]: SANDESH: Send FAILED: 1734918004926191  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.30:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  ] ] flag_infos= [  [ ] ] description = Collector connection down, No Configuration for self Number of connections:1, Expected: 3 ],  ] ] ]
2024-12-23 Mon 01:40:04:926.739 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741398636288, Pid 809]: SANDESH: Send FAILED: 1734918004926383  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Connect successful_connections = 0 pid = 809 http_port = 8085 start_time = 1734918004925713 collector_name =  collector_ip = 10.0.0.30:8086 collector_list= [  [ (*_iter40) = 10.0.0.30:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-12-23 Mon 01:40:04:939.480 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: SANDESH: Send FAILED: 1734918004939370  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:04:939.555 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: SANDESH: Send FAILED: 1734918004939426  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:5269,  ] ] status = Down description = Idle ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.30:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.30, Collector connection down, No Configuration for self Number of connections:2, Expected: 3 ],  ] ] ]
2024-12-23 Mon 01:40:04:939.575 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: SANDESH: Send FAILED: 1734918004939512  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:04:939.593 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: SANDESH: Send FAILED: 1734918004939526  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:5269,  ] ] status = Down description = Idle ],  [  type = XMPP name = dns-server:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:53,  ] ] status = Down description = Idle ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.30:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.30, XMPP:dns-server:10.0.0.30, Collector connection down, No Configuration for self ],  ] ] ]
2024-12-23 Mon 01:40:06:286.076 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741398636288, Pid 809]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2024-12-23 Mon 01:40:06:286.271 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741398636288, Pid 809]: SANDESH: Send FAILED: 1734918006286001  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:5269,  ] ] status = Down description = Idle ],  [  type = XMPP name = dns-server:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:53,  ] ] status = Down description = Idle ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.30, XMPP:dns-server:10.0.0.30, Collector connection down, No Configuration for self ],  ] ] ]
2024-12-23 Mon 01:40:06:286.664 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741398636288, Pid 809]: SANDESH: Send FAILED: 1734918006286231  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Idle successful_connections = 0 pid = 809 http_port = 8085 start_time = 1734918004925713 collector_name =  collector_ip = 10.0.0.30:8086 collector_list= [  [ (*_iter40) = 10.0.0.30:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VersionInfoLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 6,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 11,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-12-23 Mon 01:40:06:286.743 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741415429888, Pid 809]: SANDESH: Send FAILED: 1734918006286701  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:06:286.965 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741398636288, Pid 809]: SANDESH: Send FAILED: 1734918006286940  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Connect event = Connect Event local_port = 35675 remote_port = 4294967295 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:06:287.387 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741398636288, Pid 809]: SANDESH: Send FAILED: 1734918006286955  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:06:287.393 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741568547136, Pid 809]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer  RECV  Mode Client:  Event: Tcp Connect Fail  peer ip: 10.0.0.30 ( network-dns@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1302
2024-12-23 Mon 01:40:06:287.509 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741568547136, Pid 809]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer  RECV  Mode Client:  Event: Tcp Connect Fail  peer ip: 10.0.0.30 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1302
2024-12-23 Mon 01:40:06:287.525 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741419628288, Pid 809]: SANDESH: Send FAILED: 1734918006287493  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Connect event = Connect Event local_port = 41821 remote_port = 4294967295 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:06:287.602 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741415429888, Pid 809]: TCP [SYS_ERR]: TcpSessionMessageLog: Session - > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2024-12-23 Mon 01:40:06:287.674 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741419628288, Pid 809]: SANDESH: Send FAILED: 1734918006287656  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Connect next_state = Active event = EvTcpConnectFail ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:06:287.714 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741419628288, Pid 809]: TCP [SYS_ERR]: TcpSessionMessageLog: Session - > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2024-12-23 Mon 01:40:06:287.759 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741411231488, Pid 809]: SANDESH: Send FAILED: 1734918006287737  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Connect next_state = Active event = EvTcpConnectFail ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:07:232.885 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: SANDESH: Send FAILED: 1734918007232817  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:07:233.111 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741394437888, Pid 809]: SANDESH: Send FAILED: 1734918007233051  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Connect event = Connect Event local_port = 41385 remote_port = 4294967295 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:07:233.210 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741568547136, Pid 809]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer  RECV  Mode Client:  Event: Tcp Connect Fail  peer ip: 10.0.0.30 ( network-dns@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1302
2024-12-23 Mon 01:40:07:233.268 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741398636288, Pid 809]: TCP [SYS_ERR]: TcpSessionMessageLog: Session - > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2024-12-23 Mon 01:40:07:233.339 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741398636288, Pid 809]: SANDESH: Send FAILED: 1734918007233296  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Connect next_state = Active event = EvTcpConnectFail ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:07:259.908 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741398636288, Pid 809]: SANDESH: Send FAILED: 1734918007259836  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:07:260.032 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: SANDESH: Send FAILED: 1734918007260012  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Connect event = Connect Event local_port = 40441 remote_port = 4294967295 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:07:260.149 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741568547136, Pid 809]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer  RECV  Mode Client:  Event: Tcp Connect Fail  peer ip: 10.0.0.30 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1302
2024-12-23 Mon 01:40:07:260.213 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741394437888, Pid 809]: TCP [SYS_ERR]: TcpSessionMessageLog: Session - > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2024-12-23 Mon 01:40:07:260.275 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741415429888, Pid 809]: SANDESH: Send FAILED: 1734918007260240  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Connect next_state = Active event = EvTcpConnectFail ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:07:286.584 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741415429888, Pid 809]: SANDESH: Send FAILED: 1734918007286295  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:5269,  ] ] status = Down description = Idle ],  [  type = XMPP name = dns-server:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:53,  ] ] status = Down description = Idle ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.30:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.30, XMPP:dns-server:10.0.0.30, Collector connection down, No Configuration for self ],  ] ] ]
2024-12-23 Mon 01:40:07:286.730 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741415429888, Pid 809]: SANDESH: Send FAILED: 1734918007286545  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Connect successful_connections = 0 pid = 809 http_port = 8085 start_time = 1734918004925713 collector_name =  collector_ip = 10.0.0.30:8086 collector_list= [  [ (*_iter40) = 10.0.0.30:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VersionInfoLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 15,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 25,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-12-23 Mon 01:40:07:286.843 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741419628288, Pid 809]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2024-12-23 Mon 01:40:07:286.929 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741419628288, Pid 809]: SANDESH: Send FAILED: 1734918007286822  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:5269,  ] ] status = Down description = Idle ],  [  type = XMPP name = dns-server:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:53,  ] ] status = Down description = Idle ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.30, XMPP:dns-server:10.0.0.30, Collector connection down, No Configuration for self ],  ] ] ]
2024-12-23 Mon 01:40:07:287.096 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741419628288, Pid 809]: SANDESH: Send FAILED: 1734918007286909  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Idle successful_connections = 0 pid = 809 http_port = 8085 start_time = 1734918004925713 collector_name =  collector_ip = 10.0.0.30:8086 collector_list= [  [ (*_iter40) = 10.0.0.30:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VersionInfoLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 16,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 27,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-12-23 Mon 01:40:09:177.530 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741394437888, Pid 809]: SANDESH: Send FAILED: 1734918009177461  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:09:177.771 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741568547136, Pid 809]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer  RECV  Mode Client:  Event: Tcp Connect Fail  peer ip: 10.0.0.30 ( network-dns@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1302
2024-12-23 Mon 01:40:09:177.780 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741415429888, Pid 809]: SANDESH: Send FAILED: 1734918009177735  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Connect event = Connect Event local_port = 45363 remote_port = 4294967295 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:09:177.849 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741394437888, Pid 809]: TCP [SYS_ERR]: TcpSessionMessageLog: Session - > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2024-12-23 Mon 01:40:09:177.925 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741398636288, Pid 809]: SANDESH: Send FAILED: 1734918009177898  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Connect next_state = Active event = EvTcpConnectFail ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:09:204.758 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741411231488, Pid 809]: SANDESH: Send FAILED: 1734918009204575  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:09:204.805 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741411231488, Pid 809]: SANDESH: Send FAILED: 1734918009204726  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Connect event = Connect Event local_port = 35139 remote_port = 4294967295 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:09:205.137 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741568547136, Pid 809]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer  RECV  Mode Client:  Event: Tcp Connect Fail  peer ip: 10.0.0.30 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1302
2024-12-23 Mon 01:40:09:205.194 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741419628288, Pid 809]: TCP [SYS_ERR]: TcpSessionMessageLog: Session - > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2024-12-23 Mon 01:40:09:205.279 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: SANDESH: Send FAILED: 1734918009205218  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Connect next_state = Active event = EvTcpConnectFail ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:09:287.247 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: SANDESH: Send FAILED: 1734918009286962  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:5269,  ] ] status = Down description = Idle ],  [  type = XMPP name = dns-server:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:53,  ] ] status = Down description = Idle ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.30:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.30, XMPP:dns-server:10.0.0.30, Collector connection down, No Configuration for self ],  ] ] ]
2024-12-23 Mon 01:40:09:287.406 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: SANDESH: Send FAILED: 1734918009287205  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Connect successful_connections = 0 pid = 809 http_port = 8085 start_time = 1734918004925713 collector_name =  collector_ip = 10.0.0.30:8086 collector_list= [  [ (*_iter40) = 10.0.0.30:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VersionInfoLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 20,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 35,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-12-23 Mon 01:40:09:288.221 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741398636288, Pid 809]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2024-12-23 Mon 01:40:09:288.444 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741398636288, Pid 809]: SANDESH: Send FAILED: 1734918009288202  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:5269,  ] ] status = Down description = Idle ],  [  type = XMPP name = dns-server:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:53,  ] ] status = Down description = Idle ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.30, XMPP:dns-server:10.0.0.30, Collector connection down, No Configuration for self ],  ] ] ]
2024-12-23 Mon 01:40:09:288.589 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741398636288, Pid 809]: SANDESH: Send FAILED: 1734918009288423  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Idle successful_connections = 0 pid = 809 http_port = 8085 start_time = 1734918004925713 collector_name =  collector_ip = 10.0.0.30:8086 collector_list= [  [ (*_iter40) = 10.0.0.30:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VersionInfoLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 21,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 37,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-12-23 Mon 01:40:13:165.844 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741568547136, Pid 809]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer  RECV  Mode Client:  Event: Tcp Connect Fail  peer ip: 10.0.0.30 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1302
2024-12-23 Mon 01:40:13:165.868 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: SANDESH: Send FAILED: 1734918013165389  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:13:165.946 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: SANDESH: Send FAILED: 1734918013165641  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Connect event = Connect Event local_port = 33097 remote_port = 4294967295 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:13:165.958 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: TCP [SYS_ERR]: TcpSessionMessageLog: Session - > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2024-12-23 Mon 01:40:13:166.007 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: SANDESH: Send FAILED: 1734918013165994  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Connect next_state = Active event = EvTcpConnectFail ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:13:166.021 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: SANDESH: Send FAILED: 1734918013166004  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Active event = Connect failed after retries ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:13:166.126 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: SANDESH: Send FAILED: 1734918013166070  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:5269,  ] ] status = Down description = Connect ],  [  type = XMPP name = dns-server:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:53,  ] ] status = Down description = Idle ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.30, XMPP:dns-server:10.0.0.30, Collector connection down, No Configuration for self ],  ] ] ]
2024-12-23 Mon 01:40:13:289.516 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: SANDESH: Send FAILED: 1734918013288612  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:5269,  ] ] status = Down description = Connect ],  [  type = XMPP name = dns-server:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:53,  ] ] status = Down description = Idle ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.30:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.30, XMPP:dns-server:10.0.0.30, Collector connection down, No Configuration for self ],  ] ] ]
2024-12-23 Mon 01:40:13:289.693 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: SANDESH: Send FAILED: 1734918013289469  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Connect successful_connections = 0 pid = 809 http_port = 8085 start_time = 1734918004925713 collector_name =  collector_ip = 10.0.0.30:8086 collector_list= [  [ (*_iter40) = 10.0.0.30:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VersionInfoLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 25,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 44,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-12-23 Mon 01:40:13:289.845 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2024-12-23 Mon 01:40:13:290.005 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: SANDESH: Send FAILED: 1734918013289813  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:5269,  ] ] status = Down description = Connect ],  [  type = XMPP name = dns-server:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:53,  ] ] status = Down description = Idle ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.30, XMPP:dns-server:10.0.0.30, Collector connection down, No Configuration for self ],  ] ] ]
2024-12-23 Mon 01:40:13:290.196 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: SANDESH: Send FAILED: 1734918013289964  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Idle successful_connections = 0 pid = 809 http_port = 8085 start_time = 1734918004925713 collector_name =  collector_ip = 10.0.0.30:8086 collector_list= [  [ (*_iter40) = 10.0.0.30:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VersionInfoLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 26,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 46,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-12-23 Mon 01:40:13:462.130 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741398636288, Pid 809]: SANDESH: Send FAILED: 1734918013462053  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:13:462.363 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741568547136, Pid 809]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer  RECV  Mode Client:  Event: Tcp Connect Fail  peer ip: 10.0.0.30 ( network-dns@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1302
2024-12-23 Mon 01:40:13:462.368 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741419628288, Pid 809]: SANDESH: Send FAILED: 1734918013462315  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Connect event = Connect Event local_port = 46385 remote_port = 4294967295 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:13:462.457 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741415429888, Pid 809]: TCP [SYS_ERR]: TcpSessionMessageLog: Session - > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2024-12-23 Mon 01:40:13:462.522 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741419628288, Pid 809]: SANDESH: Send FAILED: 1734918013462504  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Connect next_state = Active event = EvTcpConnectFail ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:13:462.546 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741419628288, Pid 809]: SANDESH: Send FAILED: 1734918013462515  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Active event = Connect failed after retries ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:13:462.611 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741394437888, Pid 809]: SANDESH: Send FAILED: 1734918013462574  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:5269,  ] ] status = Down description = Connect ],  [  type = XMPP name = dns-server:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:53,  ] ] status = Down description = Connect ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.30, XMPP:dns-server:10.0.0.30, Collector connection down, No Configuration for self ],  ] ] ]
2024-12-23 Mon 01:40:20:950.856 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741568547136, Pid 809]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer  RECV  Mode Client:  Event: Tcp Connect Fail  peer ip: 10.0.0.30 ( network-dns@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1302
2024-12-23 Mon 01:40:20:950.861 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741415429888, Pid 809]: SANDESH: Send FAILED: 1734918020950631  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:20:950.946 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741411231488, Pid 809]: TCP [SYS_ERR]: TcpSessionMessageLog: Session - > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2024-12-23 Mon 01:40:20:950.974 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741415429888, Pid 809]: SANDESH: Send FAILED: 1734918020950822  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Connect event = Connect Event local_port = 40465 remote_port = 4294967295 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:20:950.995 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741415429888, Pid 809]: SANDESH: Send FAILED: 1734918020950984  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Connect next_state = Active event = EvTcpConnectFail ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:20:951.018 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741415429888, Pid 809]: SANDESH: Send FAILED: 1734918020950989  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Active event = Connect failed after retries ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:21:290.386 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741411231488, Pid 809]: SANDESH: Send FAILED: 1734918021290055  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:5269,  ] ] status = Down description = Connect ],  [  type = XMPP name = dns-server:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:53,  ] ] status = Down description = Connect ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.30:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.30, XMPP:dns-server:10.0.0.30, Collector connection down, No Configuration for self ],  ] ] ]
2024-12-23 Mon 01:40:21:290.459 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741411231488, Pid 809]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2024-12-23 Mon 01:40:21:290.665 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741411231488, Pid 809]: SANDESH: Send FAILED: 1734918021290339  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Connect successful_connections = 0 pid = 809 http_port = 8085 start_time = 1734918004925713 collector_name =  collector_ip = 10.0.0.30:8086 collector_list= [  [ (*_iter40) = 10.0.0.30:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 19 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VersionInfoLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 32 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 32,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 57,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-12-23 Mon 01:40:21:290.696 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741411231488, Pid 809]: SANDESH: Send FAILED: 1734918021290438  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:5269,  ] ] status = Down description = Connect ],  [  type = XMPP name = dns-server:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:53,  ] ] status = Down description = Connect ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.30, XMPP:dns-server:10.0.0.30, Collector connection down, No Configuration for self ],  ] ] ]
2024-12-23 Mon 01:40:21:290.821 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741411231488, Pid 809]: SANDESH: Send FAILED: 1734918021290519  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Idle successful_connections = 0 pid = 809 http_port = 8085 start_time = 1734918004925713 collector_name =  collector_ip = 10.0.0.30:8086 collector_list= [  [ (*_iter40) = 10.0.0.30:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VersionInfoLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 32 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 33,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 58,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-12-23 Mon 01:40:21:662.198 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: SANDESH: Send FAILED: 1734918021662149  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:21:662.399 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741568547136, Pid 809]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer  RECV  Mode Client:  Event: Tcp Connect Fail  peer ip: 10.0.0.30 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1302
2024-12-23 Mon 01:40:21:662.416 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: SANDESH: Send FAILED: 1734918021662372  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Connect event = Connect Event local_port = 41401 remote_port = 4294967295 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:21:662.463 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: TCP [SYS_ERR]: TcpSessionMessageLog: Session - > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2024-12-23 Mon 01:40:21:662.512 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: SANDESH: Send FAILED: 1734918021662492  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Connect next_state = Active event = EvTcpConnectFail ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:21:662.525 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: SANDESH: Send FAILED: 1734918021662500  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Active event = Connect failed after retries ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:34:691.116 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: SANDESH: Send FAILED: 1734918034691011  [SYS_NOTICE]: UveVrouterAgent: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local interface_list= [  [ ] ] error_intf_list= [  [ ] ] no_config_intf_list= [  [ (*_iter151) = 00000000-0000-0000-0000-000000000000,  ] ] vmi_count= [  active = 1 ] down_interface_count = 1 ]
2024-12-23 Mon 01:40:34:691.475 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741415429888, Pid 809]: SANDESH: Send FAILED: 1734918034691384  [SYS_NOTICE]: UveVirtualNetworkAgentTrace: data= [ name = __UNKNOWN__ vrf_stats_list= [  [ [  name = __untitled__ diag_packet_count = 0 unknown_unicast_floods = 0 arp_packet_counts= [  from_vm_interface= [ stats= [ proxies = 0 stitches = 0 floods = 0 ] ] from_physical_interface= [  stats= [ proxies = 0 stitches = 0 floods = 0 ] ] ] offload_packet_counts= [  gro = 0 ] nh_packet_counts= [  discards = 0 resolves = 0 l3_receives = 0 l2_receives = 0 local_vm_l3_forwards = 0 local_vm_l2_forwards = 0 vrf_translates = 0 ecmp_forwards = 0 tunnel_nh_stats= [  udp_encaps = 0 mpls_over_udp_encaps = 0 mpls_over_gre_encaps = 0 vxlan_encaps = 0 ] comp_nh_stats= [  source_replication_forwards = 0 edge_replication_forwards = 0 local_vm_l3_forwards = 0 total_multicast_forwards = 0 ] ] ],  ] ] ]
2024-12-23 Mon 01:40:34:926.253 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741398636288, Pid 809]: SANDESH: Send FAILED: 1734918034926030  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:Compute:contrail-vrouter-agent:0 sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvIdleHoldTimerExpired enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 67 dequeues = 67 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 83 dequeues = 83 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1734918021290486 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1734918034691415 ] max_sm_queue_count = 7 ]
2024-12-23 Mon 01:40:34:926.450 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741398636288, Pid 809]: SANDESH: Send FAILED: 1734918034926158  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Idle successful_connections = 0 pid = 809 http_port = 8085 start_time = 1734918004925713 collector_name =  collector_ip = 10.0.0.30:8086 collector_list= [  [ (*_iter40) = 10.0.0.30:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 27 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVirtualNetworkAgentTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVrouterAgent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VersionInfoLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 36 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 41,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 67,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-12-23 Mon 01:40:35:351.312 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741415429888, Pid 809]: SANDESH: Send FAILED: 1734918035351129  [SYS_NOTICE]: UveVrouterAgent: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local xmpp_peer_list= [  [ [  ip = 10.0.0.30 status = 0 setup_time = 0 primary = 1 ],  ] ] self_ip_list= [  [ (*_iter146) = 10.0.0.30,  ] ] build_info = {"build-info":[{"build-version":"nightly","build-time":"2024-12-23 00:11:38.498906","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-7088-1.novalocal","build-id":"nightly-nightly.el7","build-number":"@contrail"}]} phy_if= [  [ [  name = eth0 mac_address = fa:16:3e:54:b3:db ],  ] ] vhost_if= [  name = vhost0 mac_address = fa:16:3e:54:b3:db ] log_file = /var/log/contrail/vrouter-agent/contrail-vrouter-agent.log config_file = /etc/contrail/contrail-vrouter-agent.conf log_local = 1 log_level = SYS_NOTICE log_category =  sandesh_http_port = 8085 dns_servers= [  [ (*_iter149) = 10.0.0.30,  ] ] vhost_cfg= [  name = vhost0 ip = 10.0.0.30 ip_prefix_len = 24 gateway = 10.0.0.1 ] eth_name= [  [ (*_iter150) = eth0,  ] ] tunnel_type = MPLSoGRE hypervisor = kvm control_ip = 10.0.0.30 dns_server_list_cfg= [  [ (*_iter152) = 10.0.0.30:53,  ] ] control_node_list_cfg= [  [ (*_iter153) = 10.0.0.30:5269,  ] ] hostname_cfg = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local flow_cache_timeout_cfg = 0 ll_max_system_flows_cfg = 16384 ll_max_vm_flows_cfg = 16384 max_vm_flows_cfg = 100 gateway_cfg_list= [  [ ] ] headless_mode_cfg = 1 collector_server_list_cfg= [  [ (*_iter155) = 10.0.0.30:8086,  ] ] log_flow = 0 mode = VROUTER platform = HOST vr_limits= [  max_labels = 5120 max_nexthops = 524288 max_interfaces = 4355 max_vrfs = 4096 max_mirror_entries = 255 vrouter_max_bridge_entries = 262144 vrouter_max_oflow_bridge_entries = 53248 vrouter_build_info = {"build-info": [{"build-version": "nightly", "build-time": "2024-12-23 00:09:20.921145", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-7088-1.novalocal"}]} vrouter_max_flow_entries = 524288 vrouter_max_oflow_entries = 105472 vrouter_priority_tagging = 1 ] bgpaas_enabled = 0 port_mirror_enabled = 0 subcluster_name =  vr_high_watermark = 80 vr_low_watermark = 75 vr_limit_exceeded_list= [  [ ] ] res_limit = 0 res_table_limit = 0 loopback_ip = 0.0.0.0 gateway_list= [  [ (*_iter161) = 10.0.0.1,  ] ] ]
2024-12-23 Mon 01:40:35:353.282 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741415429888, Pid 809]: SANDESH: Send FAILED: 1734918035351239  [SYS_NOTICE]: VrouterStats: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local in_tpkts = 17073 in_bytes = 1186568 out_tpkts = 63276 out_bytes = 584649027 exception_packets = 60 exception_packets_dropped = 9 exception_packets_allowed = 51 total_flows = 0 aged_flows = 0 uptime = 1734918004689997 phy_if_info= [  [ _iter254->first = eth0 [  speed = -1 duplexity = 255 ],  ] ] raw_vhost_stats= [  name = vhost0 in_pkts = 17073 in_bytes = 1186568 out_pkts = 63276 out_bytes = 584649027 speed = -1 duplexity = -1 ] raw_vhost_drop_stats= [  ds_discard = 0 ds_pull = 0 ds_invalid_if = 0 ds_invalid_arp = 0 ds_trap_no_if = 0 ds_nowhere_to_go = 0 ds_flow_queue_limit_exceeded = 0 ds_flow_no_memory = 0 ds_flow_invalid_protocol = 0 ds_flow_nat_no_rflow = 0 ds_flow_action_drop = 0 ds_flow_action_invalid = 0 ds_flow_unusable = 0 ds_flow_table_full = 0 ds_interface_tx_discard = 0 ds_interface_drop = 65 ds_duplicated = 0 ds_push = 0 ds_ttl_exceeded = 0 ds_invalid_nh = 0 ds_invalid_label = 0 ds_invalid_protocol = 0 ds_interface_rx_discard = 0 ds_invalid_mcast_source = 0 ds_head_alloc_fail = 0 ds_pcow_fail = 0 ds_mcast_clone_fail = 0 ds_rewrite_fail = 0 ds_misc = 0 ds_invalid_packet = 0 ds_cksum_err = 0 ds_no_fmd = 0 ds_invalid_vnid = 0 ds_frag_err = 0 ds_invalid_source = 0 ds_mcast_df_bit = 0 ds_l2_no_route = 0 ds_vlan_fwd_tx = 0 ds_vlan_fwd_enq = 0 ds_drop_new_flow = 0 ds_flow_evict = 0 ds_trap_original = 0 ds_no_memory = 0 ds_fragment_queue_fail = 0 ds_no_frag_entry = 0 ds_icmp_error = 0 ds_clone_fail = 0 ds_drop_pkts = 65 ] raw_drop_stats= [  ds_discard = 0 ds_pull = 0 ds_invalid_if = 0 ds_invalid_arp = 0 ds_trap_no_if = 0 ds_nowhere_to_go = 0 ds_flow_queue_limit_exceeded = 0 ds_flow_no_memory = 0 ds_flow_invalid_protocol = 0 ds_flow_nat_no_rflow = 0 ds_flow_action_drop = 0 ds_flow_action_invalid = 0 ds_flow_unusable = 0 ds_flow_table_full = 0 ds_interface_tx_discard = 0 ds_interface_drop = 66 ds_duplicated = 0 ds_push = 0 ds_ttl_exceeded = 0 ds_invalid_nh = 0 ds_invalid_label = 0 ds_invalid_protocol = 0 ds_interface_rx_discard = 0 ds_invalid_mcast_source = 0 ds_head_alloc_fail = 0 ds_pcow_fail = 0 ds_mcast_clone_fail = 0 ds_rewrite_fail = 0 ds_misc = 0 ds_invalid_packet = 0 ds_cksum_err = 0 ds_no_fmd = 0 ds_invalid_vnid = 0 ds_frag_err = 0 ds_invalid_source = 0 ds_mcast_df_bit = 0 ds_l2_no_route = 0 ds_vlan_fwd_tx = 0 ds_vlan_fwd_enq = 0 ds_drop_new_flow = 0 ds_flow_evict = 0 ds_trap_original = 0 ds_no_memory = 0 ds_fragment_queue_fail = 0 ds_no_frag_entry = 0 ds_icmp_error = 0 ds_clone_fail = 0 ds_drop_pkts = 66 ] flow_rate= [  added_flows = 0 max_flow_adds_per_second = 0 min_flow_adds_per_second = 0 deleted_flows = 0 max_flow_deletes_per_second = 0 min_flow_deletes_per_second = 0 active_flows = 0 hold_flows = 0 ] raw_phy_if_stats= [  [ _iter262->first = eth0 [  in_pkts = 63219 in_bytes = 584646633 out_pkts = 17076 out_bytes = 1186694 ],  ] ] raw_phy_if_drop_stats= [  [ _iter263->first = eth0 [  ds_discard = 0 ds_pull = 0 ds_invalid_if = 0 ds_invalid_arp = 0 ds_trap_no_if = 0 ds_nowhere_to_go = 0 ds_flow_queue_limit_exceeded = 0 ds_flow_no_memory = 0 ds_flow_invalid_protocol = 0 ds_flow_nat_no_rflow = 0 ds_flow_action_drop = 0 ds_flow_action_invalid = 0 ds_flow_unusable = 0 ds_flow_table_full = 0 ds_interface_tx_discard = 0 ds_interface_drop = 65 ds_duplicated = 0 ds_push = 0 ds_ttl_exceeded = 0 ds_invalid_nh = 0 ds_invalid_label = 0 ds_invalid_protocol = 0 ds_interface_rx_discard = 0 ds_invalid_mcast_source = 0 ds_head_alloc_fail = 0 ds_pcow_fail = 0 ds_mcast_clone_fail = 0 ds_rewrite_fail = 0 ds_misc = 0 ds_invalid_packet = 0 ds_cksum_err = 0 ds_no_fmd = 0 ds_invalid_vnid = 0 ds_frag_err = 0 ds_invalid_source = 0 ds_mcast_df_bit = 0 ds_l2_no_route = 0 ds_vlan_fwd_tx = 0 ds_vlan_fwd_enq = 0 ds_drop_new_flow = 0 ds_flow_evict = 0 ds_trap_original = 0 ds_no_memory = 0 ds_fragment_queue_fail = 0 ds_no_frag_entry = 0 ds_icmp_error = 0 ds_clone_fail = 0 ds_drop_pkts = 65 ],  ] ] ]
2024-12-23 Mon 01:40:35:353.335 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741415429888, Pid 809]: SANDESH: Send FAILED: 1734918035351336  [SYS_NOTICE]: VrouterControlStatsTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local raw_xmpp_stats= [  [ _iter306->first = 10.0.0.30 [  reconnects = 0 in_msgs = 0 out_msgs = 0 ],  ] ] raw_ifmap_stats= [  [ _iter307->first = link_delete_parse_errors _iter307->second = 0,  _iter307->first = link_update_parse_errors _iter307->second = 0,  _iter307->first = node_delete_parse_errors _iter307->second = 0,  _iter307->first = node_update_parse_errors _iter307->second = 0,  ] ] raw_rt_table_size= [  [ _iter308->first = default-domain:default-project:ip-fabric:__default__ [  inet4_unicast = 7 inet4_multicast = 0 evpn = 0 bridge = 5 inet6_unicast = 2 ],  _iter308->first = default-domain:default-project:ip-fabric:ip-fabric [  inet4_unicast = 2 inet4_multicast = 0 evpn = 1 bridge = 2 inet6_unicast = 0 ],  ] ] ]
2024-12-23 Mon 01:40:36:350.745 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: SANDESH: Send FAILED: 1734918036350667  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:36:350.898 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741568547136, Pid 809]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer  RECV  Mode Client:  Event: Tcp Connect Fail  peer ip: 10.0.0.30 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1302
2024-12-23 Mon 01:40:36:350.905 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741411231488, Pid 809]: SANDESH: Send FAILED: 1734918036350866  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Connect event = Connect Event local_port = 42059 remote_port = 4294967295 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:36:350.981 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: TCP [SYS_ERR]: TcpSessionMessageLog: Session - > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2024-12-23 Mon 01:40:36:351.031 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741411231488, Pid 809]: SANDESH: Send FAILED: 1734918036351014  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Connect next_state = Active event = EvTcpConnectFail ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:36:351.043 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741411231488, Pid 809]: SANDESH: Send FAILED: 1734918036351022  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Active event = Connect failed after retries ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:37:223.322 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741411231488, Pid 809]: SANDESH: Send FAILED: 1734918037223113  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:37:223.376 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741411231488, Pid 809]: SANDESH: Send FAILED: 1734918037223285  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Connect event = Connect Event local_port = 35447 remote_port = 4294967295 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:37:223.418 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741568547136, Pid 809]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer  RECV  Mode Client:  Event: Tcp Connect Fail  peer ip: 10.0.0.30 ( network-dns@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1302
2024-12-23 Mon 01:40:37:223.460 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741398636288, Pid 809]: TCP [SYS_ERR]: TcpSessionMessageLog: Session - > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2024-12-23 Mon 01:40:37:223.574 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741398636288, Pid 809]: SANDESH: Send FAILED: 1734918037223483  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Connect next_state = Active event = EvTcpConnectFail ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:37:223.586 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741398636288, Pid 809]: SANDESH: Send FAILED: 1734918037223487  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Active event = Connect failed after retries ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:40:37:290.971 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741415429888, Pid 809]: SANDESH: Send FAILED: 1734918037290644  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:5269,  ] ] status = Down description = Connect ],  [  type = XMPP name = dns-server:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:53,  ] ] status = Down description = Connect ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.30:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.30, XMPP:dns-server:10.0.0.30, Collector connection down, No Configuration for self ],  ] ] ]
2024-12-23 Mon 01:40:37:291.223 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741415429888, Pid 809]: SANDESH: Send FAILED: 1734918037290917  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Connect successful_connections = 0 pid = 809 http_port = 8085 start_time = 1734918004925713 collector_name =  collector_ip = 10.0.0.30:8086 collector_list= [  [ (*_iter40) = 10.0.0.30:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 31 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVirtualNetworkAgentTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVrouterAgent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VersionInfoLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterControlStatsTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterStats [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 44 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 47,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 80,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-12-23 Mon 01:40:37:291.326 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741419628288, Pid 809]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2024-12-23 Mon 01:40:37:291.451 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741419628288, Pid 809]: SANDESH: Send FAILED: 1734918037291308  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:5269,  ] ] status = Down description = Connect ],  [  type = XMPP name = dns-server:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:53,  ] ] status = Down description = Connect ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.30, XMPP:dns-server:10.0.0.30, Collector connection down, No Configuration for self ],  ] ] ]
2024-12-23 Mon 01:40:37:291.639 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741419628288, Pid 809]: SANDESH: Send FAILED: 1734918037291419  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Idle successful_connections = 0 pid = 809 http_port = 8085 start_time = 1734918004925713 collector_name =  collector_ip = 10.0.0.30:8086 collector_list= [  [ (*_iter40) = 10.0.0.30:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 32 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVirtualNetworkAgentTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVrouterAgent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VersionInfoLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterControlStatsTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterStats [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 44 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 48,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 82,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-12-23 Mon 01:41:04:929.291 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741411231488, Pid 809]: SANDESH: Send FAILED: 1734918064929117  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:Compute:contrail-vrouter-agent:0 sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvIdleHoldTimerExpired enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 84 dequeues = 84 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 103 dequeues = 103 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1734918037291351 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1734918037291482 ] max_sm_queue_count = 7 ]
2024-12-23 Mon 01:41:04:929.496 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741411231488, Pid 809]: SANDESH: Send FAILED: 1734918064929217  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Idle successful_connections = 0 pid = 809 http_port = 8085 start_time = 1734918004925713 collector_name =  collector_ip = 10.0.0.30:8086 collector_list= [  [ (*_iter40) = 10.0.0.30:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 42 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVirtualNetworkAgentTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVrouterAgent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VersionInfoLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterControlStatsTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterStats [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 44 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 58,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 84,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-12-23 Mon 01:41:05:352.445 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: SANDESH: Send FAILED: 1734918065351919  [SYS_NOTICE]: VrouterStats: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local cpu_info= [  num_cpu = 4 sys_mem_info= [  total = 25639936 used = 0 free = 481160750 buffers = 32536 cached = 25503648 node_type =  ] meminfo= [  virt = 32536 peakvirt = 467089816 res = 32536 ] cpuload= [  one_min_avg = 8.06 five_min_avg = 2.6 fifteen_min_avg = 0.9375 ] cpu_share = 0.437583 ] ]
2024-12-23 Mon 01:41:05:352.513 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: SANDESH: Send FAILED: 1734918065351940  [SYS_NOTICE]: ComputeCpuStateTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local cpu_info= [  [ [  mem_virt = 32536 cpu_share = 0.437583 used_sys_mem = 4269431112 one_min_cpuload = 8.06 mem_res = 32536 ],  ] ] ]
2024-12-23 Mon 01:41:05:352.660 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: SANDESH: Send FAILED: 1734918065351968  [SYS_NOTICE]: VrouterStats: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local in_tpkts = 39690 in_bytes = 2812231 out_tpkts = 113919 out_bytes = 1026291062 exception_packets = 61 exception_packets_allowed = 52 raw_vhost_stats= [  name = vhost0 in_pkts = 39690 in_bytes = 2812231 out_pkts = 113919 out_bytes = 1026291062 speed = -1 duplexity = -1 ] raw_vhost_drop_stats= [  ds_discard = 0 ds_pull = 0 ds_invalid_if = 0 ds_invalid_arp = 0 ds_trap_no_if = 0 ds_nowhere_to_go = 0 ds_flow_queue_limit_exceeded = 0 ds_flow_no_memory = 0 ds_flow_invalid_protocol = 0 ds_flow_nat_no_rflow = 0 ds_flow_action_drop = 0 ds_flow_action_invalid = 0 ds_flow_unusable = 0 ds_flow_table_full = 0 ds_interface_tx_discard = 0 ds_interface_drop = 95 ds_duplicated = 0 ds_push = 0 ds_ttl_exceeded = 0 ds_invalid_nh = 0 ds_invalid_label = 0 ds_invalid_protocol = 0 ds_interface_rx_discard = 0 ds_invalid_mcast_source = 0 ds_head_alloc_fail = 0 ds_pcow_fail = 0 ds_mcast_clone_fail = 0 ds_rewrite_fail = 0 ds_misc = 0 ds_invalid_packet = 0 ds_cksum_err = 0 ds_no_fmd = 0 ds_invalid_vnid = 0 ds_frag_err = 0 ds_invalid_source = 0 ds_mcast_df_bit = 0 ds_l2_no_route = 0 ds_vlan_fwd_tx = 0 ds_vlan_fwd_enq = 0 ds_drop_new_flow = 0 ds_flow_evict = 0 ds_trap_original = 0 ds_no_memory = 0 ds_fragment_queue_fail = 0 ds_no_frag_entry = 0 ds_icmp_error = 0 ds_clone_fail = 0 ds_drop_pkts = 95 ] raw_drop_stats= [  ds_discard = 0 ds_pull = 0 ds_invalid_if = 0 ds_invalid_arp = 0 ds_trap_no_if = 0 ds_nowhere_to_go = 0 ds_flow_queue_limit_exceeded = 0 ds_flow_no_memory = 0 ds_flow_invalid_protocol = 0 ds_flow_nat_no_rflow = 0 ds_flow_action_drop = 0 ds_flow_action_invalid = 0 ds_flow_unusable = 0 ds_flow_table_full = 0 ds_interface_tx_discard = 0 ds_interface_drop = 95 ds_duplicated = 0 ds_push = 0 ds_ttl_exceeded = 0 ds_invalid_nh = 0 ds_invalid_label = 0 ds_invalid_protocol = 0 ds_interface_rx_discard = 0 ds_invalid_mcast_source = 0 ds_head_alloc_fail = 0 ds_pcow_fail = 0 ds_mcast_clone_fail = 0 ds_rewrite_fail = 0 ds_misc = 0 ds_invalid_packet = 0 ds_cksum_err = 0 ds_no_fmd = 0 ds_invalid_vnid = 0 ds_frag_err = 0 ds_invalid_source = 0 ds_mcast_df_bit = 0 ds_l2_no_route = 0 ds_vlan_fwd_tx = 0 ds_vlan_fwd_enq = 0 ds_drop_new_flow = 0 ds_flow_evict = 0 ds_trap_original = 0 ds_no_memory = 0 ds_fragment_queue_fail = 0 ds_no_frag_entry = 0 ds_icmp_error = 0 ds_clone_fail = 0 ds_drop_pkts = 95 ] flow_rate= [  added_flows = 0 max_flow_adds_per_second = 0 min_flow_adds_per_second = 0 deleted_flows = 0 max_flow_deletes_per_second = 0 min_flow_deletes_per_second = 0 active_flows = 0 hold_flows = 0 ] raw_phy_if_stats= [  [ _iter262->first = eth0 [  in_pkts = 113847 in_bytes = 1026288038 out_pkts = 39693 out_bytes = 2812357 ],  ] ] raw_phy_if_drop_stats= [  [ _iter263->first = eth0 [  ds_discard = 0 ds_pull = 0 ds_invalid_if = 0 ds_invalid_arp = 0 ds_trap_no_if = 0 ds_nowhere_to_go = 0 ds_flow_queue_limit_exceeded = 0 ds_flow_no_memory = 0 ds_flow_invalid_protocol = 0 ds_flow_nat_no_rflow = 0 ds_flow_action_drop = 0 ds_flow_action_invalid = 0 ds_flow_unusable = 0 ds_flow_table_full = 0 ds_interface_tx_discard = 0 ds_interface_drop = 95 ds_duplicated = 0 ds_push = 0 ds_ttl_exceeded = 0 ds_invalid_nh = 0 ds_invalid_label = 0 ds_invalid_protocol = 0 ds_interface_rx_discard = 0 ds_invalid_mcast_source = 0 ds_head_alloc_fail = 0 ds_pcow_fail = 0 ds_mcast_clone_fail = 0 ds_rewrite_fail = 0 ds_misc = 0 ds_invalid_packet = 0 ds_cksum_err = 0 ds_no_fmd = 0 ds_invalid_vnid = 0 ds_frag_err = 0 ds_invalid_source = 0 ds_mcast_df_bit = 0 ds_l2_no_route = 0 ds_vlan_fwd_tx = 0 ds_vlan_fwd_enq = 0 ds_drop_new_flow = 0 ds_flow_evict = 0 ds_trap_original = 0 ds_no_memory = 0 ds_fragment_queue_fail = 0 ds_no_frag_entry = 0 ds_icmp_error = 0 ds_clone_fail = 0 ds_drop_pkts = 95 ],  ] ] ]
2024-12-23 Mon 01:41:05:352.718 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: SANDESH: Send FAILED: 1734918065352687  [SYS_NOTICE]: VrouterControlStatsTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local raw_xmpp_stats= [  [ _iter306->first = 10.0.0.30 [  reconnects = 0 in_msgs = 0 out_msgs = 0 ],  ] ] raw_ifmap_stats= [  [ _iter307->first = link_delete_parse_errors _iter307->second = 0,  _iter307->first = link_update_parse_errors _iter307->second = 0,  _iter307->first = node_delete_parse_errors _iter307->second = 0,  _iter307->first = node_update_parse_errors _iter307->second = 0,  ] ] raw_rt_table_size= [  [ _iter308->first = default-domain:default-project:ip-fabric:__default__ [  inet4_unicast = 7 inet4_multicast = 0 evpn = 0 bridge = 5 inet6_unicast = 2 ],  _iter308->first = default-domain:default-project:ip-fabric:ip-fabric [  inet4_unicast = 2 inet4_multicast = 0 evpn = 1 bridge = 2 inet6_unicast = 0 ],  ] ] ]
2024-12-23 Mon 01:41:07:294.212 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: SANDESH: Send FAILED: 1734918067292605  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:5269,  ] ] status = Down description = Connect ],  [  type = XMPP name = dns-server:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:53,  ] ] status = Down description = Connect ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.30:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.30, XMPP:dns-server:10.0.0.30, Collector connection down, No Configuration for self ],  ] ] ]
2024-12-23 Mon 01:41:07:294.290 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2024-12-23 Mon 01:41:07:294.553 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: SANDESH: Send FAILED: 1734918067294172  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Connect successful_connections = 0 pid = 809 http_port = 8085 start_time = 1734918004925713 collector_name =  collector_ip = 10.0.0.30:8086 collector_list= [  [ (*_iter40) = 10.0.0.30:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ComputeCpuStateTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 44 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVirtualNetworkAgentTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVrouterAgent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VersionInfoLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterControlStatsTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterStats [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 44 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 60,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 90,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-12-23 Mon 01:41:07:294.586 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: SANDESH: Send FAILED: 1734918067294273  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:5269,  ] ] status = Down description = Connect ],  [  type = XMPP name = dns-server:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:53,  ] ] status = Down description = Connect ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.30, XMPP:dns-server:10.0.0.30, Collector connection down, No Configuration for self ],  ] ] ]
2024-12-23 Mon 01:41:07:294.757 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: SANDESH: Send FAILED: 1734918067294353  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Idle successful_connections = 0 pid = 809 http_port = 8085 start_time = 1734918004925713 collector_name =  collector_ip = 10.0.0.30:8086 collector_list= [  [ (*_iter40) = 10.0.0.30:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ComputeCpuStateTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 45 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVirtualNetworkAgentTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVrouterAgent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VersionInfoLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterControlStatsTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterStats [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 44 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 61,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 91,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-12-23 Mon 01:41:07:402.498 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741398636288, Pid 809]: SANDESH: Send FAILED: 1734918067402358  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:41:07:406.465 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741568547136, Pid 809]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:10.0.0.30 RECV  Mode Client:  Event: Tcp Connected  peer ip: 10.0.0.30 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1295
2024-12-23 Mon 01:41:07:406.608 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: SANDESH: Send FAILED: 1734918067406516  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Connect event = Connect Event local_port = 36891 remote_port = 5269 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:41:07:407.467 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741419628288, Pid 809]: SANDESH: Send FAILED: 1734918067407442  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Connect next_state = OpenSent event = EvTcpConnected local_port = 36891 remote_port = 5269 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:41:07:414.267 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741568547136, Pid 809]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:10.0.0.30 RECV  Mode Client:  Event: Tcp Connection Closed  peer ip: 10.0.0.30 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1310
2024-12-23 Mon 01:41:07:414.658 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: SANDESH: Send FAILED: 1734918067414341  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = OpenSent next_state = Established event = EvXmppOpen identifier = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:41:07:414.679 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: SANDESH: Send FAILED: 1734918067414370  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Established next_state = Active event = EvTcpClose ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:41:07:414.689 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: SANDESH: Send FAILED: 1734918067414373  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Active event = Connect failed after retries ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:41:07:414.710 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: SANDESH: Send FAILED: 1734918067414465  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:5269,  ] ] status = Up description = Established ],  [  type = XMPP name = dns-server:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:53,  ] ] status = Down description = Connect ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  ] ] flag_infos= [  [ ] ] description = XMPP:dns-server:10.0.0.30, Collector connection down, No Configuration for self ],  ] ] ]
2024-12-23 Mon 01:41:07:414.728 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: SANDESH: Send FAILED: 1734918067414582  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:5269,  ] ] status = Down description = Established ],  [  type = XMPP name = dns-server:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:53,  ] ] status = Down description = Connect ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.30, XMPP:dns-server:10.0.0.30, Collector connection down, No Configuration for self ],  ] ] ]
2024-12-23 Mon 01:41:09:354.026 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741415429888, Pid 809]: SANDESH: Send FAILED: 1734918069353921  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Active next_state = Connect event = EvConnectTimerExpired ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:41:09:354.646 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741568547136, Pid 809]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer  RECV  Mode Client:  Event: Tcp Connect Fail  peer ip: 10.0.0.30 ( network-dns@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1302
2024-12-23 Mon 01:41:09:354.696 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741394437888, Pid 809]: TCP [SYS_ERR]: TcpSessionMessageLog: Session - > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314
2024-12-23 Mon 01:41:09:354.774 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741394437888, Pid 809]: SANDESH: Send FAILED: 1734918069354673  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Connect event = Connect Event local_port = 41921 remote_port = 4294967295 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:41:09:354.788 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741394437888, Pid 809]: SANDESH: Send FAILED: 1734918069354720  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Connect next_state = Active event = EvTcpConnectFail ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:41:09:354.798 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741394437888, Pid 809]: SANDESH: Send FAILED: 1734918069354723  [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.0.0.30 state = Active event = Connect failed after retries ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709
2024-12-23 Mon 01:41:34:938.902 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: SANDESH: Send FAILED: 1734918094936498  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:Compute:contrail-vrouter-agent:0 sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvIdleHoldTimerExpired enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 106 dequeues = 106 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 128 dequeues = 128 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1734918067294320 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1734918069354794 ] max_sm_queue_count = 7 ]
2024-12-23 Mon 01:41:34:939.216 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: SANDESH: Send FAILED: 1734918094938651  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Idle successful_connections = 0 pid = 809 http_port = 8085 start_time = 1734918004925713 collector_name =  collector_ip = 10.0.0.30:8086 collector_list= [  [ (*_iter40) = 10.0.0.30:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ComputeCpuStateTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 21 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 53 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVirtualNetworkAgentTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVrouterAgent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VersionInfoLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterControlStatsTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterStats [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 54 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 72,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 106,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-12-23 Mon 01:41:35:352.247 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741411231488, Pid 809]: SANDESH: Send FAILED: 1734918095352154  [SYS_NOTICE]: UveVrouterAgent: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local xmpp_peer_list= [  [ [  ip = 10.0.0.30 status = 0 setup_time = 1734918067414471 primary = 0 ],  ] ] ]
2024-12-23 Mon 01:41:35:352.431 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741411231488, Pid 809]: SANDESH: Send FAILED: 1734918095352198  [SYS_NOTICE]: VrouterStats: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local in_tpkts = 40592 in_bytes = 2933899 out_tpkts = 114942 out_bytes = 1026830108 exception_packets = 63 exception_packets_dropped = 10 exception_packets_allowed = 53 raw_vhost_stats= [  name = vhost0 in_pkts = 40592 in_bytes = 2933899 out_pkts = 114942 out_bytes = 1026830108 speed = -1 duplexity = -1 ] raw_vhost_drop_stats= [  ds_discard = 0 ds_pull = 0 ds_invalid_if = 0 ds_invalid_arp = 0 ds_trap_no_if = 0 ds_nowhere_to_go = 0 ds_flow_queue_limit_exceeded = 0 ds_flow_no_memory = 0 ds_flow_invalid_protocol = 0 ds_flow_nat_no_rflow = 0 ds_flow_action_drop = 0 ds_flow_action_invalid = 0 ds_flow_unusable = 0 ds_flow_table_full = 0 ds_interface_tx_discard = 0 ds_interface_drop = 114 ds_duplicated = 0 ds_push = 0 ds_ttl_exceeded = 0 ds_invalid_nh = 0 ds_invalid_label = 0 ds_invalid_protocol = 0 ds_interface_rx_discard = 0 ds_invalid_mcast_source = 0 ds_head_alloc_fail = 0 ds_pcow_fail = 0 ds_mcast_clone_fail = 0 ds_rewrite_fail = 0 ds_misc = 0 ds_invalid_packet = 0 ds_cksum_err = 0 ds_no_fmd = 0 ds_invalid_vnid = 0 ds_frag_err = 0 ds_invalid_source = 0 ds_mcast_df_bit = 0 ds_l2_no_route = 0 ds_vlan_fwd_tx = 0 ds_vlan_fwd_enq = 0 ds_drop_new_flow = 0 ds_flow_evict = 0 ds_trap_original = 0 ds_no_memory = 0 ds_fragment_queue_fail = 0 ds_no_frag_entry = 0 ds_icmp_error = 0 ds_clone_fail = 0 ds_drop_pkts = 114 ] raw_drop_stats= [  ds_discard = 0 ds_pull = 0 ds_invalid_if = 0 ds_invalid_arp = 0 ds_trap_no_if = 0 ds_nowhere_to_go = 0 ds_flow_queue_limit_exceeded = 0 ds_flow_no_memory = 0 ds_flow_invalid_protocol = 0 ds_flow_nat_no_rflow = 0 ds_flow_action_drop = 0 ds_flow_action_invalid = 0 ds_flow_unusable = 0 ds_flow_table_full = 0 ds_interface_tx_discard = 0 ds_interface_drop = 114 ds_duplicated = 0 ds_push = 0 ds_ttl_exceeded = 0 ds_invalid_nh = 0 ds_invalid_label = 0 ds_invalid_protocol = 0 ds_interface_rx_discard = 0 ds_invalid_mcast_source = 0 ds_head_alloc_fail = 0 ds_pcow_fail = 0 ds_mcast_clone_fail = 0 ds_rewrite_fail = 0 ds_misc = 0 ds_invalid_packet = 0 ds_cksum_err = 0 ds_no_fmd = 0 ds_invalid_vnid = 0 ds_frag_err = 0 ds_invalid_source = 0 ds_mcast_df_bit = 0 ds_l2_no_route = 0 ds_vlan_fwd_tx = 0 ds_vlan_fwd_enq = 0 ds_drop_new_flow = 0 ds_flow_evict = 0 ds_trap_original = 0 ds_no_memory = 0 ds_fragment_queue_fail = 0 ds_no_frag_entry = 0 ds_icmp_error = 0 ds_clone_fail = 0 ds_drop_pkts = 114 ] total_in_bandwidth_utilization = 3.19608e-10 total_out_bandwidth_utilization = 1.26297e-12 flow_rate= [  added_flows = 0 max_flow_adds_per_second = 0 min_flow_adds_per_second = 0 deleted_flows = 0 max_flow_deletes_per_second = 0 min_flow_deletes_per_second = 0 active_flows = 0 hold_flows = 0 ] phy_band_in_bps= [  [ _iter260->first = eth0 _iter260->second = 58957309,  ] ] phy_band_out_bps= [  [ _iter261->first = eth0 _iter261->second = 232977,  ] ] raw_phy_if_stats= [  [ _iter262->first = eth0 [  in_pkts = 114855 in_bytes = 1026826454 out_pkts = 40595 out_bytes = 2934025 ],  ] ] raw_phy_if_drop_stats= [  [ _iter263->first = eth0 [  ds_discard = 0 ds_pull = 0 ds_invalid_if = 0 ds_invalid_arp = 0 ds_trap_no_if = 0 ds_nowhere_to_go = 0 ds_flow_queue_limit_exceeded = 0 ds_flow_no_memory = 0 ds_flow_invalid_protocol = 0 ds_flow_nat_no_rflow = 0 ds_flow_action_drop = 0 ds_flow_action_invalid = 0 ds_flow_unusable = 0 ds_flow_table_full = 0 ds_interface_tx_discard = 0 ds_interface_drop = 114 ds_duplicated = 0 ds_push = 0 ds_ttl_exceeded = 0 ds_invalid_nh = 0 ds_invalid_label = 0 ds_invalid_protocol = 0 ds_interface_rx_discard = 0 ds_invalid_mcast_source = 0 ds_head_alloc_fail = 0 ds_pcow_fail = 0 ds_mcast_clone_fail = 0 ds_rewrite_fail = 0 ds_misc = 0 ds_invalid_packet = 0 ds_cksum_err = 0 ds_no_fmd = 0 ds_invalid_vnid = 0 ds_frag_err = 0 ds_invalid_source = 0 ds_mcast_df_bit = 0 ds_l2_no_route = 0 ds_vlan_fwd_tx = 0 ds_vlan_fwd_enq = 0 ds_drop_new_flow = 0 ds_flow_evict = 0 ds_trap_original = 0 ds_no_memory = 0 ds_fragment_queue_fail = 0 ds_no_frag_entry = 0 ds_icmp_error = 0 ds_clone_fail = 0 ds_drop_pkts = 114 ],  ] ] ]
2024-12-23 Mon 01:41:35:352.489 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741411231488, Pid 809]: SANDESH: Send FAILED: 1734918095352461  [SYS_NOTICE]: VrouterControlStatsTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local raw_xmpp_stats= [  [ _iter306->first = 10.0.0.30 [  reconnects = 1 in_msgs = 0 out_msgs = 1 ],  ] ] raw_ifmap_stats= [  [ _iter307->first = link_delete_parse_errors _iter307->second = 0,  _iter307->first = link_update_parse_errors _iter307->second = 0,  _iter307->first = node_delete_parse_errors _iter307->second = 0,  _iter307->first = node_update_parse_errors _iter307->second = 0,  ] ] raw_rt_table_size= [  [ _iter308->first = default-domain:default-project:ip-fabric:__default__ [  inet4_unicast = 7 inet4_multicast = 0 evpn = 0 bridge = 5 inet6_unicast = 2 ],  _iter308->first = default-domain:default-project:ip-fabric:ip-fabric [  inet4_unicast = 2 inet4_multicast = 0 evpn = 1 bridge = 2 inet6_unicast = 0 ],  ] ] ]
2024-12-23 Mon 01:41:37:298.148 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741411231488, Pid 809]: SANDESH: Send FAILED: 1734918097295194  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:5269,  ] ] status = Down description = Established ],  [  type = XMPP name = dns-server:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:53,  ] ] status = Down description = Connect ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.30:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.30, XMPP:dns-server:10.0.0.30, Collector connection down, No Configuration for self ],  ] ] ]
2024-12-23 Mon 01:41:37:298.445 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741411231488, Pid 809]: SANDESH: Send FAILED: 1734918097298115  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = Connect successful_connections = 0 pid = 809 http_port = 8085 start_time = 1734918004925713 collector_name =  collector_ip = 10.0.0.30:8086 collector_list= [  [ (*_iter40) = 10.0.0.30:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ComputeCpuStateTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 21 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 54 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVirtualNetworkAgentTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVrouterAgent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VersionInfoLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterControlStatsTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterStats [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 54 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 73,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 111,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-12-23 Mon 01:41:37:298.477 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741411231488, Pid 809]: SANDESH: Send FAILED: 1734918097298201  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local process_status= [  [ [  module_id = contrail-vrouter-agent instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = XMPP name = control-node:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:5269,  ] ] status = Down description = Established ],  [  type = XMPP name = dns-server:10.0.0.30 server_addrs= [  [ (*_iter6) = 10.0.0.30:53,  ] ] status = Down description = Connect ],  [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.30:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  ] ] flag_infos= [  [ ] ] description = XMPP:control-node:10.0.0.30, XMPP:dns-server:10.0.0.30, Collector connection down, No Configuration for self ],  ] ] ]
2024-12-23 Mon 01:41:37:298.639 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741411231488, Pid 809]: SANDESH: Send FAILED: 1734918097298272  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:Compute:contrail-vrouter-agent:0 client_info= [  status = ClientInit successful_connections = 1 pid = 809 http_port = 8085 start_time = 1734918004925713 collector_name =  collector_ip = 10.0.0.30:8086 collector_list= [  [ (*_iter40) = 10.0.0.30:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = ComputeCpuStateTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 54 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVirtualNetworkAgentTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = UveVrouterAgent [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VersionInfoLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrfObjectLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterControlStatsTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = VrouterStats [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppConnectionLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 54 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = XmppEventLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 73,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 112,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2024-12-23 Mon 01:41:38:517.634 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741568547136, Pid 809]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:10.0.0.30 RECV  Mode Client:  Event: Tcp Connected  peer ip: 10.0.0.30 ( network-dns@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1295
2024-12-23 Mon 01:41:39:007.118 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741568547136, Pid 809]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:10.0.0.30 RECV  Mode Client:  Event: Tcp Connected  peer ip: 10.0.0.30 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1295
2024-12-23 Mon 01:41:39:030.613 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741568547136, Pid 809]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:10.0.0.30 RECV  Mode Client:  Event: Tcp Connection Closed  peer ip: 10.0.0.30 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1310
2024-12-23 Mon 01:42:08:192.928 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741568547136, Pid 809]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-k8s-manifests-120-1.cluster.local:10.0.0.30 RECV  Mode Client:  Event: Tcp Connected  peer ip: 10.0.0.30 ( network-control@contrailsystems.com ) controller/src/xmpp/xmpp_state_machine.cc 1295
2024-12-23 Mon 01:44:59:781.810 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741415429888, Pid 809]: Error <19: No such device> querying mac-address for interface <tapeth0-6b17b0> Agent-index <8>
2024-12-23 Mon 01:45:06:581.986 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741398636288, Pid 809]: ID-PERM not set for object <default-domain:k8s-default:a1fa08a3-1558-4fe1-84e2-ec31e42dde2d> Table <__ifmap__.service_instance.0>. Ignoring it
2024-12-23 Mon 01:45:07:212.248 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: Error <19: No such device> querying mac-address for interface <tapeth0-606b50> Agent-index <5>
2024-12-23 Mon 01:45:12:253.952 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: Error <19: No such device> querying mac-address for interface <tapeth0-98f4e4> Agent-index <6>
2024-12-23 Mon 01:48:59:337.888 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: Error <19: No such device> querying mac-address for interface <tapeth0-2aeadf> Agent-index <5>
2024-12-23 Mon 01:48:59:341.010 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: Error <19: No such device> querying mac-address for interface <tapeth0-2aeadf> Agent-index <5>
2024-12-23 Mon 01:48:59:347.197 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: Error <19: No such device> querying mac-address for interface <tapeth0-2aeadf> Agent-index <5>
2024-12-23 Mon 01:48:59:388.783 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: Error <19: No such device> querying mac-address for interface <tapeth0-4b06f1> Agent-index <7>
2024-12-23 Mon 01:48:59:403.557 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: Error <19: No such device> querying mac-address for interface <tapeth0-436243> Agent-index <8>
2024-12-23 Mon 01:48:59:406.182 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: Error <19: No such device> querying mac-address for interface <tapeth0-436243> Agent-index <8>
2024-12-23 Mon 01:48:59:439.736 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: Error <19: No such device> querying mac-address for interface <tapeth0-436243> Agent-index <8>
2024-12-23 Mon 01:48:59:442.148 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: Error <19: No such device> querying mac-address for interface <tapeth0-240975> Agent-index <6>
2024-12-23 Mon 01:48:59:446.577 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741423826688, Pid 809]: Error <19: No such device> querying mac-address for interface <tapeth0-240975> Agent-index <6>
2024-12-23 Mon 01:49:29:324.516 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741411231488, Pid 809]: Error <19: No such device> querying mac-address for interface <tapeth0-d64072> Agent-index <11>
2024-12-23 Mon 01:49:29:368.197 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: Error <19: No such device> querying mac-address for interface <tapeth0-183507> Agent-index <9>
2024-12-23 Mon 01:49:29:371.141 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: Error <19: No such device> querying mac-address for interface <tapeth0-98492b> Agent-index <12>
2024-12-23 Mon 01:49:29:373.731 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: Error <19: No such device> querying mac-address for interface <tapeth0-98492b> Agent-index <12>
2024-12-23 Mon 01:49:29:376.879 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: Error <19: No such device> querying mac-address for interface <tapeth0-98492b> Agent-index <12>
2024-12-23 Mon 01:49:29:379.515 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: Error <19: No such device> querying mac-address for interface <tapeth0-0be73d> Agent-index <10>
2024-12-23 Mon 01:49:29:382.108 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: Error <19: No such device> querying mac-address for interface <tapeth0-0be73d> Agent-index <10>
2024-12-23 Mon 01:49:29:384.429 UTC  cn-jenkins-deploy-platform-k8s-manifests-120-1 [Thread 139741402834688, Pid 809]: Error <19: No such device> querying mac-address for interface <tapeth0-0be73d> Agent-index <10>