2025-09-01 Mon 02:52:10:766.206 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: http-server-port 8091
2025-09-01 Mon 02:52:10:766.298 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: Max-tasks 16
2025-09-01 Mon 02:52:10:766.306 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: Max-slice 100
2025-09-01 Mon 02:52:10:766.312 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: Collectors  10.0.0.254:8086
2025-09-01 Mon 02:52:10:766.318 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: Collectors  10.0.0.38:8086
2025-09-01 Mon 02:52:10:766.323 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: Collectors  10.0.0.48:8086
2025-09-01 Mon 02:52:10:766.341 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: SANDESH: ROLE             : Generator
2025-09-01 Mon 02:52:10:766.348 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: SANDESH: MODULE           : contrail-query-engine
2025-09-01 Mon 02:52:10:766.424 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: SANDESH: SOURCE           : cn-jenkins-deploy-platform-ansible-os-3996-3.
2025-09-01 Mon 02:52:10:766.430 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: SANDESH: NODE TYPE        : Database
2025-09-01 Mon 02:52:10:766.435 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: SANDESH: INSTANCE ID      : 0
2025-09-01 Mon 02:52:10:766.441 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: SANDESH: HTTP SERVER PORT : 8091
2025-09-01 Mon 02:52:10:766.447 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: SANDESH: System Log Send Rate Limit: 0 -> 0
2025-09-01 Mon 02:52:10:767.021 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: HTTP Introspect Init
2025-09-01 Mon 02:52:10:767.120 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8091  Initialization complete src/contrail-common/io/tcp_server.cc 137
2025-09-01 Mon 02:52:10:767.176 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: Sandesh Http Server Port: 8091
2025-09-01 Mon 02:52:10:767.210 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: SANDESH: NOT Writing http_port 8091TO : /tmp/contrail-query-engine.0.http_port
2025-09-01 Mon 02:52:10:767.219 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: SANDESH: CONNECT TO COLLECTOR: 1
2025-09-01 Mon 02:52:10:767.289 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: Idle
2025-09-01 Mon 02:52:10:767.442 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: SANDESH: No Client: 1756695130767370  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3996-3.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1756695130767299 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 0,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-09-01 Mon 02:52:10:767.560 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: SANDESH: Logging: DISABLED -> ENABLED
2025-09-01 Mon 02:52:10:767.574 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ]
2025-09-01 Mon 02:52:10:767.586 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: Cassandra Servers: 10.0.0.254:9042 10.0.0.38:9042 10.0.0.48:9042 
2025-09-01 Mon 02:52:10:767.673 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Processing scm::EvStart in state Idle
2025-09-01 Mon 02:52:10:767.738 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Disconnect
2025-09-01 Mon 02:52:10:767.808 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Processing scm::EvCollectorUpdate in state Disconnect
2025-09-01 Mon 02:52:10:768.021 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Connect : Start Connect timer 10.0.0.48:8086
2025-09-01 Mon 02:52:10:768.089 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-09-01 Mon 02:52:10:768.110 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: SANDESH: Send FAILED: 1756695130767730  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3996-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Idle : EvStart -> Disconnect ],  ] ] flag_infos= [  [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ],  ] ] ]
2025-09-01 Mon 02:52:10:768.120 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-09-01 Mon 02:52:10:768.128 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-09-01 Mon 02:52:10:768.206 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: SANDESH: Send FAILED: 1756695130767798  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3996-3.:Database:contrail-query-engine:0 client_info= [  status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1756695130767299 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-09-01 Mon 02:52:10:768.222 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-09-01 Mon 02:52:10:768.232 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-09-01 Mon 02:52:10:768.299 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: SANDESH: Send FAILED: 1756695130767867  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3996-3.:Database:contrail-query-engine:0 client_info= [  status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1756695130767299 collector_name =  collector_ip = 10.0.0.48:8086 collector_list= [  [ (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.254:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-09-01 Mon 02:52:10:768.312 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-09-01 Mon 02:52:10:768.322 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-09-01 Mon 02:52:10:768.336 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: SANDESH: Send FAILED: 1756695130767888  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3996-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.48:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  ] ] flag_infos= [  [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ],  ] ] ]
2025-09-01 Mon 02:52:10:768.343 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-09-01 Mon 02:52:10:768.350 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-09-01 Mon 02:52:10:768.412 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: SANDESH: Send FAILED: 1756695130768078  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3996-3.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1756695130767299 collector_name =  collector_ip = 10.0.0.48:8086 collector_list= [  [ (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.254:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-09-01 Mon 02:52:10:768.424 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-09-01 Mon 02:52:10:778.403 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-09-01 Mon 02:52:10:778.437 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-09-01 Mon 02:52:10:778.597 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 0 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-09-01 Mon 02:52:10:778.654 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423712904960, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-09-01 Mon 02:52:10:778.684 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423712904960, Pid 1]: SANDESH: Send FAILED: 1756695130778472  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3996-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.48:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2025-09-01 Mon 02:52:10:778.694 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423712904960, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-09-01 Mon 02:52:15:786.036 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-09-01 Mon 02:52:15:786.076 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-09-01 Mon 02:52:15:786.113 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 1 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-09-01 Mon 02:52:20:789.510 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-09-01 Mon 02:52:20:789.657 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-09-01 Mon 02:52:20:789.679 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 2 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-09-01 Mon 02:52:25:791.336 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-09-01 Mon 02:52:25:791.382 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-09-01 Mon 02:52:25:791.405 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 3 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-09-01 Mon 02:52:30:792.824 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-09-01 Mon 02:52:30:792.875 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-09-01 Mon 02:52:30:792.896 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 4 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-09-01 Mon 02:52:35:908.947 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004
2025-09-01 Mon 02:52:35:908.994 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-09-01 Mon 02:52:35:909.018 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 5 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-09-01 Mon 02:52:40:937.849 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-09-01 Mon 02:52:40:937.923 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 6 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-09-01 Mon 02:52:45:958.591 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: Older table does not exist. will query only the new table src/contrail-analytics/contrail-query-engine/query.cc 1037
2025-09-01 Mon 02:52:50:964.986 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-09-01 Mon 02:52:50:965.031 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: -(-1) OnSessionEvent TCP Connect Failed
2025-09-01 Mon 02:52:50:965.099 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: SANDESH: Send FAILED: 1756695170964895  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3996-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.48:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2025-09-01 Mon 02:52:50:965.123 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-09-01 Mon 02:52:50:965.103 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: -(-1):EvTcpConnectFail
2025-09-01 Mon 02:52:50:965.154 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Processing scm::EvTcpConnectFail in state Connect
2025-09-01 Mon 02:52:50:965.163 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: RAC_Connect status: 0 0xdea5f0
2025-09-01 Mon 02:52:50:965.178 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: Connected to REDIS...

2025-09-01 Mon 02:52:50:965.196 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-01 Mon 02:52:50:965.210 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: RAC_Connect status: 0 0xdeaca0
2025-09-01 Mon 02:52:50:965.218 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: Connected to REDIS...

2025-09-01 Mon 02:52:50:965.231 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-01 Mon 02:52:50:965.245 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: RAC_Connect status: 0 0xde41d0
2025-09-01 Mon 02:52:50:965.250 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: Connected to REDIS...

2025-09-01 Mon 02:52:50:965.259 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-01 Mon 02:52:50:965.268 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: RAC_Connect status: 0 0xdeb340
2025-09-01 Mon 02:52:50:965.273 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: Connected to REDIS...

2025-09-01 Mon 02:52:50:965.281 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-01 Mon 02:52:50:965.290 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: RAC_Connect status: 0 0xdeb870
2025-09-01 Mon 02:52:50:965.295 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: Connected to REDIS...

2025-09-01 Mon 02:52:50:965.303 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-01 Mon 02:52:50:965.312 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: RAC_Connect status: 0 0xdeefe0
2025-09-01 Mon 02:52:50:965.326 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: Connected to REDIS...

2025-09-01 Mon 02:52:50:965.334 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.48 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-01 Mon 02:52:50:965.343 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: RAC_Connect status: 0 0xdef920
2025-09-01 Mon 02:52:50:965.348 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: Connected to REDIS...

2025-09-01 Mon 02:52:50:965.356 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.48 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-01 Mon 02:52:50:965.365 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: RAC_Connect status: 0 0xdec1a0
2025-09-01 Mon 02:52:50:965.370 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: Connected to REDIS...

2025-09-01 Mon 02:52:50:965.378 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-01 Mon 02:52:50:965.387 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: RAC_Connect status: 0 0xdecae0
2025-09-01 Mon 02:52:50:965.392 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: Connected to REDIS...

2025-09-01 Mon 02:52:50:965.399 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-01 Mon 02:52:50:965.408 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: RAC_Connect status: 0 0xdf0260
2025-09-01 Mon 02:52:50:965.413 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: Connected to REDIS...

2025-09-01 Mon 02:52:50:965.421 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.48 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-01 Mon 02:52:50:965.429 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: RAC_Connect status: 0 0xded420
2025-09-01 Mon 02:52:50:965.435 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: Connected to REDIS...

2025-09-01 Mon 02:52:50:965.442 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-01 Mon 02:52:50:965.451 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: RAC_Connect status: 0 0xdedd60
2025-09-01 Mon 02:52:50:965.456 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: Connected to REDIS...

2025-09-01 Mon 02:52:50:965.465 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-01 Mon 02:52:50:965.474 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: RAC_Connect status: 0 0xdee6a0
2025-09-01 Mon 02:52:50:965.479 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: Connected to REDIS...

2025-09-01 Mon 02:52:50:965.487 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-01 Mon 02:52:50:965.498 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: RAC_Connect status: 0 0xdf0ba0
2025-09-01 Mon 02:52:50:965.504 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: Connected to REDIS...

2025-09-01 Mon 02:52:50:965.512 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.48 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-01 Mon 02:52:50:965.520 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: RAC_Connect status: 0 0xdf14e0
2025-09-01 Mon 02:52:50:965.525 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: Connected to REDIS...

2025-09-01 Mon 02:52:50:965.533 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.48 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-01 Mon 02:52:50:965.165 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Connect : EvTcpConnectFail
2025-09-01 Mon 02:52:50:965.780 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312
2025-09-01 Mon 02:52:50:965.863 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Idle
2025-09-01 Mon 02:52:50:965.927 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-01 Mon 02:52:50:965.935 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-09-01 Mon 02:52:50:965.964 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-01 Mon 02:52:50:966.017 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-01 Mon 02:52:50:966.041 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-01 Mon 02:52:50:966.064 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-01 Mon 02:52:50:966.081 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-01 Mon 02:52:50:966.102 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-01 Mon 02:52:50:966.112 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-01 Mon 02:52:50:966.123 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: SANDESH: Send FAILED: 1756695170965710  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3996-3.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1756695130767299 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.254:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 36 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 37,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-09-01 Mon 02:52:50:966.159 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-09-01 Mon 02:52:50:966.126 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-01 Mon 02:52:50:966.171 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-09-01 Mon 02:52:50:966.197 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-01 Mon 02:52:50:966.225 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: SANDESH: Send FAILED: 1756695170965742  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3996-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2025-09-01 Mon 02:52:50:966.235 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-09-01 Mon 02:52:50:966.243 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-01 Mon 02:52:50:966.246 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle
2025-09-01 Mon 02:52:50:966.267 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-01 Mon 02:52:50:966.298 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-01 Mon 02:52:50:966.309 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-01 Mon 02:52:50:966.316 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-09-01 Mon 02:52:50:966.324 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-01 Mon 02:52:50:966.341 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-01 Mon 02:52:50:966.362 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-01 Mon 02:52:50:966.378 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-01 Mon 02:52:50:966.392 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-01 Mon 02:52:50:966.408 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-01 Mon 02:52:50:966.474 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: SANDESH: Send FAILED: 1756695170965925  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3996-3.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1756695130767299 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.254:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 36 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 38,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-09-01 Mon 02:52:50:966.492 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-01 Mon 02:52:50:966.493 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-09-01 Mon 02:52:50:966.536 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-01 Mon 02:52:50:966.549 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-09-01 Mon 02:52:50:966.589 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-01 Mon 02:52:50:966.597 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: SANDESH: Send FAILED: 1756695170966474  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3996-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.48:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2025-09-01 Mon 02:52:50:966.617 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-01 Mon 02:52:50:966.619 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-09-01 Mon 02:52:50:966.643 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-01 Mon 02:52:50:966.652 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-09-01 Mon 02:52:50:966.675 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-01 Mon 02:52:50:966.680 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: SANDESH: Send FAILED: 1756695170966528  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3996-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.48:6379,  ] ] status = Up description = 10.0.0.38:6379::Down.10.0.0.48:6379::Down. ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-09-01 Mon 02:52:50:966.714 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-09-01 Mon 02:52:50:966.703 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-01 Mon 02:52:50:966.730 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-09-01 Mon 02:52:50:966.756 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-01 Mon 02:52:50:966.771 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: SANDESH: Send FAILED: 1756695170966580  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3996-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.48:6379,  ] ] status = Up description = 10.0.0.38:6379::Down. ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-09-01 Mon 02:52:50:966.782 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-09-01 Mon 02:52:50:966.789 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-01 Mon 02:52:50:966.831 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-01 Mon 02:52:50:966.892 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-01 Mon 02:52:50:966.906 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-01 Mon 02:52:50:966.928 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-01 Mon 02:52:50:966.938 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-01 Mon 02:52:50:966.959 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-01 Mon 02:52:50:966.973 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-01 Mon 02:52:50:966.986 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-01 Mon 02:52:50:966.995 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-01 Mon 02:52:50:967.008 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-01 Mon 02:52:50:967.017 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-01 Mon 02:52:50:967.060 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-01 Mon 02:52:50:967.090 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-01 Mon 02:52:50:967.104 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-01 Mon 02:52:50:967.116 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-01 Mon 02:52:50:967.129 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-01 Mon 02:52:50:966.907 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-09-01 Mon 02:52:50:967.510 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: SANDESH: Send FAILED: 1756695170966822  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3996-3.:Database:contrail-query-engine:0 sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 13 dequeues = 13 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 17 dequeues = 17 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1756695170965861 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1756695170966728 ] max_sm_queue_count = 5 ]
2025-09-01 Mon 02:52:50:967.518 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-09-01 Mon 02:52:50:967.526 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-09-01 Mon 02:52:50:967.623 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: SANDESH: Send FAILED: 1756695170966886  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3996-3.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1756695130767299 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.254:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 66 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 68,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 13,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-09-01 Mon 02:52:50:967.639 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-09-01 Mon 02:52:50:967.649 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-09-01 Mon 02:52:50:967.670 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: SANDESH: Send FAILED: 1756695170967082  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3996-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.48:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-09-01 Mon 02:52:50:967.677 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-09-01 Mon 02:52:51:965.981 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423699646208, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle
2025-09-01 Mon 02:52:51:966.201 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423699646208, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086
2025-09-01 Mon 02:52:51:966.310 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423699646208, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-09-01 Mon 02:52:51:966.340 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423699646208, Pid 1]: SANDESH: Send FAILED: 1756695171966056  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3996-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.48:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-09-01 Mon 02:52:51:966.349 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423699646208, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-09-01 Mon 02:52:51:966.358 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423699646208, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-09-01 Mon 02:52:51:966.473 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423699646208, Pid 1]: SANDESH: Send FAILED: 1756695171966300  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3996-3.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1756695130767299 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.254:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 81 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 83,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 16,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-09-01 Mon 02:52:51:966.493 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423699646208, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-09-01 Mon 02:52:51:968.626 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.48:33878::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280
2025-09-01 Mon 02:52:51:969.219 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: 10.0.0.48:33878::10.0.0.38:8086(-1) OnSessionEvent TCP Connected
2025-09-01 Mon 02:52:51:969.240 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: 10.0.0.48:33878::10.0.0.38:8086(-1):EvTcpConnected
2025-09-01 Mon 02:52:51:969.288 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423699646208, Pid 1]: Processing scm::EvTcpConnected in state Connect
2025-09-01 Mon 02:52:51:969.305 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423699646208, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer
2025-09-01 Mon 02:52:51:969.335 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423699646208, Pid 1]: ClientInit
2025-09-01 Mon 02:52:51:969.353 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423699646208, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-3996-3.:contrail-query-engine:0:Database count 1
2025-09-01 Mon 02:52:51:969.431 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423699646208, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2025-09-01 Mon 02:52:51:969.440 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423699646208, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE
2025-09-01 Mon 02:52:51:969.461 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423699646208, Pid 1]: SANDESH: Send FAILED: 1756695171969329  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3996-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.48:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-09-01 Mon 02:52:51:969.469 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423699646208, Pid 1]: Received UVE message in wrong state : NodeStatusUVE
2025-09-01 Mon 02:52:51:969.477 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423699646208, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2025-09-01 Mon 02:52:51:969.484 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423699646208, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer
2025-09-01 Mon 02:52:51:969.495 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423699646208, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2025-09-01 Mon 02:52:51:969.501 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423699646208, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace
2025-09-01 Mon 02:52:51:969.611 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423699646208, Pid 1]: SANDESH: Send FAILED: 1756695171969412  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3996-3.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1756695130767299 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.254:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 81 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 84,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-09-01 Mon 02:52:51:969.629 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423699646208, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace
2025-09-01 Mon 02:52:51:971.265 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423733896960, Pid 1]: OnMessage control in state: ClientInit
2025-09-01 Mon 02:52:51:971.310 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423733896960, Pid 1]: Processing scm::EvSandeshMessageRecv in state ClientInit
2025-09-01 Mon 02:52:51:971.321 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423733896960, Pid 1]: ClientInit : EvSandeshMessageRecv
2025-09-01 Mon 02:52:51:971.345 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423733896960, Pid 1]: Received Ctrl Message with size 0
2025-09-01 Mon 02:52:51:971.494 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423733896960, Pid 1]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-3996-3.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1756695130767299 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.254:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 13 dequeues = 13 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 17 dequeues = 17 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1756695170965861 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1756695170966728 ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 81 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 84,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18,  _iter59->first = sent _iter59->second = 0,  ] ] max_sm_queue_count = 5 proxy  seq 10
2025-09-01 Mon 02:52:51:971.518 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423733896960, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1
2025-09-01 Mon 02:52:51:971.542 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423733896960, Pid 1]: SyncUVE Syncing ObjectDatabaseInfo val name = cn-jenkins-deploy-platform-ansible-os-3996-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.48:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] proxy  seq 11
2025-09-01 Mon 02:52:51:971.554 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423733896960, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1
2025-09-01 Mon 02:52:51:971.564 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423733896960, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 without seqno , total = 0
2025-09-01 Mon 02:52:51:971.571 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423733896960, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0
2025-09-01 Mon 02:52:51:971.598 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423733896960, Pid 1]: Established
2025-09-01 Mon 02:53:00:909.334 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423058138880, Pid 1]: OnMessage control in state: Established
2025-09-01 Mon 02:53:00:909.422 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423058138880, Pid 1]: Processing scm::EvSandeshMessageRecv in state Established
2025-09-01 Mon 02:53:00:909.435 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423058138880, Pid 1]: Established : EvSandeshMessageRecv
2025-09-01 Mon 02:53:00:909.479 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423058138880, Pid 1]: Received Ctrl Message with size 3
2025-09-01 Mon 02:53:00:909.493 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423058138880, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 with seqno 11, total = 0
2025-09-01 Mon 02:53:00:909.504 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423058138880, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 with seqno 13, total = 0
2025-09-01 Mon 02:53:00:909.516 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423058138880, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 with seqno 1, total = 0
2025-09-01 Mon 02:53:00:909.524 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423058138880, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0
2025-09-01 Mon 02:53:20:967.810 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423738095360, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 1 without seqno , total = 0
2025-09-01 Mon 02:54:20:971.064 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423083325184, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 2 without seqno , total = 0
2025-09-01 Mon 02:55:16:172.342 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.48:8091::10.0.0.48:52884 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254
2025-09-01 Mon 02:55:20:974.410 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423058138880, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 3 without seqno , total = 0
2025-09-01 Mon 02:55:37:399.849 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.48:8091::10.0.0.48:43826 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254
2025-09-01 Mon 02:56:20:975.080 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423070734080, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 4 without seqno , total = 0
2025-09-01 Mon 02:57:20:976.440 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423699646208, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 5 without seqno , total = 0
2025-09-01 Mon 02:57:27:349.397 UTC  cn-jenkins-deploy-platform-ansible-os-3996-3 [Thread 140423885965440, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.48:8091::10.0.0.48:47140 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254