2025-08-04 Mon 05:34:43:924.331 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: http-server-port 8091
2025-08-04 Mon 05:34:43:924.433 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: Max-tasks 16
2025-08-04 Mon 05:34:43:924.441 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: Max-slice 100
2025-08-04 Mon 05:34:43:924.553 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: Collectors  10.0.0.254:8086
2025-08-04 Mon 05:34:43:924.562 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: Collectors  10.0.0.38:8086
2025-08-04 Mon 05:34:43:924.567 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: Collectors  10.0.0.50:8086
2025-08-04 Mon 05:34:43:924.589 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: SANDESH: ROLE             : Generator
2025-08-04 Mon 05:34:43:924.595 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: SANDESH: MODULE           : contrail-query-engine
2025-08-04 Mon 05:34:43:924.600 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: SANDESH: SOURCE           : cn-jenkins-deploy-platform-ansible-os-3751-1.
2025-08-04 Mon 05:34:43:924.606 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: SANDESH: NODE TYPE        : Database
2025-08-04 Mon 05:34:43:924.611 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: SANDESH: INSTANCE ID      : 0
2025-08-04 Mon 05:34:43:924.627 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: SANDESH: HTTP SERVER PORT : 8091
2025-08-04 Mon 05:34:43:924.644 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: SANDESH: System Log Send Rate Limit: 0 -> 0
2025-08-04 Mon 05:34:43:925.640 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: HTTP Introspect Init
2025-08-04 Mon 05:34:43:925.884 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8091  Initialization complete src/contrail-common/io/tcp_server.cc 137
2025-08-04 Mon 05:34:43:926.035 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: Sandesh Http Server Port: 8091
2025-08-04 Mon 05:34:43:926.086 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: SANDESH: NOT Writing http_port 8091TO : /tmp/contrail-query-engine.0.http_port
2025-08-04 Mon 05:34:43:926.096 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: SANDESH: CONNECT TO COLLECTOR: 1
2025-08-04 Mon 05:34:43:926.269 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: Idle
2025-08-04 Mon 05:34:43:926.699 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: SANDESH: No Client: 1754285683926466  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3751-1.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1754285683926345 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 0,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-08-04 Mon 05:34:43:926.927 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: SANDESH: Logging: DISABLED -> ENABLED
2025-08-04 Mon 05:34:43:926.945 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ]
2025-08-04 Mon 05:34:43:926.958 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: Cassandra Servers: 10.0.0.254:9042 10.0.0.38:9042 10.0.0.50:9042 
2025-08-04 Mon 05:34:43:927.066 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990583781120, Pid 1]: Processing scm::EvStart in state Idle
2025-08-04 Mon 05:34:43:927.129 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990583781120, Pid 1]: Disconnect
2025-08-04 Mon 05:34:43:935.648 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990583781120, Pid 1]: Processing scm::EvCollectorUpdate in state Disconnect
2025-08-04 Mon 05:34:43:939.228 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990583781120, Pid 1]: Connect : Start Connect timer 10.0.0.254:8086
2025-08-04 Mon 05:34:43:939.318 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990583781120, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-08-04 Mon 05:34:43:939.340 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990583781120, Pid 1]: SANDESH: Send FAILED: 1754285683927122  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3751-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Idle : EvStart -> Disconnect ],  ] ] flag_infos= [  [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ],  ] ] ]
2025-08-04 Mon 05:34:43:939.350 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990583781120, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-08-04 Mon 05:34:43:939.359 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990583781120, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-08-04 Mon 05:34:43:939.437 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990583781120, Pid 1]: SANDESH: Send FAILED: 1754285683935614  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3751-1.:Database:contrail-query-engine:0 client_info= [  status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1754285683926345 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-08-04 Mon 05:34:43:939.452 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990583781120, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-08-04 Mon 05:34:43:939.462 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990583781120, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-08-04 Mon 05:34:43:939.549 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990583781120, Pid 1]: SANDESH: Send FAILED: 1754285683935732  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3751-1.:Database:contrail-query-engine:0 client_info= [  status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1754285683926345 collector_name =  collector_ip = 10.0.0.254:8086 collector_list= [  [ (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-08-04 Mon 05:34:43:939.563 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990583781120, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-08-04 Mon 05:34:43:939.572 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990583781120, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-08-04 Mon 05:34:43:939.587 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990583781120, Pid 1]: SANDESH: Send FAILED: 1754285683939094  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3751-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  ] ] flag_infos= [  [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ],  ] ] ]
2025-08-04 Mon 05:34:43:939.593 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990583781120, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-08-04 Mon 05:34:43:939.601 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990583781120, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-08-04 Mon 05:34:43:939.670 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990583781120, Pid 1]: SANDESH: Send FAILED: 1754285683939305  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3751-1.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1754285683926345 collector_name =  collector_ip = 10.0.0.254:8086 collector_list= [  [ (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-08-04 Mon 05:34:43:939.682 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990583781120, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-08-04 Mon 05:34:43:948.647 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-08-04 Mon 05:34:43:948.676 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-08-04 Mon 05:34:43:948.737 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 0 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-08-04 Mon 05:34:43:948.782 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990361171712, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-08-04 Mon 05:34:43:948.812 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990361171712, Pid 1]: SANDESH: Send FAILED: 1754285683948711  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3751-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2025-08-04 Mon 05:34:43:948.821 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990361171712, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-08-04 Mon 05:34:48:956.255 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-08-04 Mon 05:34:48:956.302 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-08-04 Mon 05:34:48:956.339 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 1 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-08-04 Mon 05:34:53:960.848 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-08-04 Mon 05:34:53:960.889 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-08-04 Mon 05:34:53:960.912 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 2 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-08-04 Mon 05:34:58:966.060 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-08-04 Mon 05:34:58:966.096 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-08-04 Mon 05:34:58:966.118 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 3 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-08-04 Mon 05:35:04:115.620 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004
2025-08-04 Mon 05:35:04:115.676 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-08-04 Mon 05:35:04:115.708 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 4 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-08-04 Mon 05:35:09:415.556 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004
2025-08-04 Mon 05:35:09:415.596 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-08-04 Mon 05:35:09:415.619 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 5 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-08-04 Mon 05:35:14:507.600 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004
2025-08-04 Mon 05:35:14:507.630 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-08-04 Mon 05:35:14:507.662 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 6 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-08-04 Mon 05:35:19:532.151 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: Older table does not exist. will query only the new table src/contrail-analytics/contrail-query-engine/query.cc 1037
2025-08-04 Mon 05:35:19:532.205 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 7 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-08-04 Mon 05:35:24:567.283 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: Older table does not exist. will query only the new table src/contrail-analytics/contrail-query-engine/query.cc 1037
2025-08-04 Mon 05:35:24:570.621 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: RAC_Connect status: 0 0x24ec5f0
2025-08-04 Mon 05:35:24:570.663 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: Connected to REDIS...

2025-08-04 Mon 05:35:24:570.685 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-04 Mon 05:35:24:570.699 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: RAC_Connect status: 0 0x24ece00
2025-08-04 Mon 05:35:24:570.705 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: Connected to REDIS...

2025-08-04 Mon 05:35:24:570.714 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-04 Mon 05:35:24:570.724 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: RAC_Connect status: 0 0x24ed150
2025-08-04 Mon 05:35:24:570.729 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: Connected to REDIS...

2025-08-04 Mon 05:35:24:570.737 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-04 Mon 05:35:24:570.746 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: RAC_Connect status: 0 0x24ed870
2025-08-04 Mon 05:35:24:570.751 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: Connected to REDIS...

2025-08-04 Mon 05:35:24:570.759 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-04 Mon 05:35:24:570.768 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: RAC_Connect status: 0 0x24ee190
2025-08-04 Mon 05:35:24:570.774 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: Connected to REDIS...

2025-08-04 Mon 05:35:24:570.782 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-04 Mon 05:35:24:570.790 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: RAC_Connect status: 0 0x24ef3d0
2025-08-04 Mon 05:35:24:570.796 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: Connected to REDIS...

2025-08-04 Mon 05:35:24:570.804 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-04 Mon 05:35:24:570.821 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: RAC_Connect status: 0 0x24f0650
2025-08-04 Mon 05:35:24:570.827 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: Connected to REDIS...

2025-08-04 Mon 05:35:24:570.835 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-04 Mon 05:35:24:570.854 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: RAC_Connect status: 0 0x24f0f90
2025-08-04 Mon 05:35:24:570.860 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: Connected to REDIS...

2025-08-04 Mon 05:35:24:570.868 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-04 Mon 05:35:24:570.877 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: RAC_Connect status: 0 0x24efd10
2025-08-04 Mon 05:35:24:570.882 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: Connected to REDIS...

2025-08-04 Mon 05:35:24:570.890 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-04 Mon 05:35:24:570.898 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: RAC_Connect status: 0 0x24eea90
2025-08-04 Mon 05:35:24:570.904 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: Connected to REDIS...

2025-08-04 Mon 05:35:24:570.911 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-04 Mon 05:35:24:570.920 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: RAC_Connect status: 0 0x24f18d0
2025-08-04 Mon 05:35:24:570.925 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: Connected to REDIS...

2025-08-04 Mon 05:35:24:570.933 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-04 Mon 05:35:24:570.942 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: RAC_Connect status: 0 0x24f3490
2025-08-04 Mon 05:35:24:570.947 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: Connected to REDIS...

2025-08-04 Mon 05:35:24:570.955 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-04 Mon 05:35:24:570.963 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: RAC_Connect status: 0 0x24f2210
2025-08-04 Mon 05:35:24:570.968 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: Connected to REDIS...

2025-08-04 Mon 05:35:24:570.976 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-04 Mon 05:35:24:570.985 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: RAC_Connect status: 0 0x24f2b50
2025-08-04 Mon 05:35:24:570.990 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: Connected to REDIS...

2025-08-04 Mon 05:35:24:570.998 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-04 Mon 05:35:24:571.006 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: RAC_Connect status: 0 0x24f3dd0
2025-08-04 Mon 05:35:24:571.012 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: Connected to REDIS...

2025-08-04 Mon 05:35:24:571.032 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-04 Mon 05:35:24:571.067 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: -(-1) OnSessionEvent TCP Connect Failed
2025-08-04 Mon 05:35:24:571.075 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: -(-1):EvTcpConnectFail
2025-08-04 Mon 05:35:24:571.242 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-08-04 Mon 05:35:24:571.291 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: SANDESH: Send FAILED: 1754285724570521  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3751-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2025-08-04 Mon 05:35:24:571.301 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-08-04 Mon 05:35:24:571.312 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: Processing scm::EvTcpConnectFail in state Connect
2025-08-04 Mon 05:35:24:571.320 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: Connect : EvTcpConnectFail
2025-08-04 Mon 05:35:24:571.447 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312
2025-08-04 Mon 05:35:24:571.570 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: Idle
2025-08-04 Mon 05:35:24:571.714 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-08-04 Mon 05:35:24:571.825 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: SANDESH: Send FAILED: 1754285724571399  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3751-1.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1754285683926345 collector_name =  collector_ip = 10.0.0.50:8086 collector_list= [  [ (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 39 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 40,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-08-04 Mon 05:35:24:571.843 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-08-04 Mon 05:35:24:571.853 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-08-04 Mon 05:35:24:571.872 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: SANDESH: Send FAILED: 1754285724571423  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3751-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2025-08-04 Mon 05:35:24:571.880 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-08-04 Mon 05:35:24:571.888 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle
2025-08-04 Mon 05:35:24:571.927 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-08-04 Mon 05:35:24:572.025 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: SANDESH: Send FAILED: 1754285724571704  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3751-1.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1754285683926345 collector_name =  collector_ip = 10.0.0.50:8086 collector_list= [  [ (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 39 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 41,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-08-04 Mon 05:35:24:572.039 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-08-04 Mon 05:35:24:572.112 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-08-04 Mon 05:35:24:572.153 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: SANDESH: Send FAILED: 1754285724572055  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3751-1.:Database:contrail-query-engine:0 sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 14 dequeues = 14 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1754285724571568 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1754285724571925 ] max_sm_queue_count = 5 ]
2025-08-04 Mon 05:35:24:572.160 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-08-04 Mon 05:35:24:572.168 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-08-04 Mon 05:35:24:572.260 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: SANDESH: Send FAILED: 1754285724572101  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3751-1.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1754285683926345 collector_name =  collector_ip = 10.0.0.50:8086 collector_list= [  [ (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 40 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 42,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-08-04 Mon 05:35:24:572.272 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-08-04 Mon 05:35:24:571.718 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-04 Mon 05:35:24:572.643 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-04 Mon 05:35:24:572.667 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-04 Mon 05:35:24:572.684 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-04 Mon 05:35:24:572.701 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-04 Mon 05:35:24:572.711 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-04 Mon 05:35:24:572.723 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-04 Mon 05:35:24:572.732 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-04 Mon 05:35:24:572.745 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-04 Mon 05:35:24:572.754 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-04 Mon 05:35:24:572.766 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-04 Mon 05:35:24:572.775 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-04 Mon 05:35:24:572.787 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-04 Mon 05:35:24:572.796 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-04 Mon 05:35:24:572.809 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-04 Mon 05:35:24:572.818 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-04 Mon 05:35:24:572.869 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-04 Mon 05:35:24:572.903 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-04 Mon 05:35:24:572.921 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-04 Mon 05:35:24:572.938 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-04 Mon 05:35:24:572.957 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-04 Mon 05:35:24:572.980 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-04 Mon 05:35:24:573.004 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-04 Mon 05:35:24:573.020 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-04 Mon 05:35:24:572.873 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990571185920, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-08-04 Mon 05:35:24:573.034 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-04 Mon 05:35:24:573.065 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-04 Mon 05:35:24:573.071 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990571185920, Pid 1]: SANDESH: Send FAILED: 1754285724572853  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3751-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2025-08-04 Mon 05:35:24:573.079 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-04 Mon 05:35:24:573.092 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-04 Mon 05:35:24:573.106 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-04 Mon 05:35:24:573.115 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-04 Mon 05:35:24:573.128 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-04 Mon 05:35:24:573.137 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-04 Mon 05:35:24:573.149 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-04 Mon 05:35:24:573.161 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-04 Mon 05:35:24:573.173 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-04 Mon 05:35:24:573.183 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-04 Mon 05:35:24:573.194 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-04 Mon 05:35:24:573.203 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-04 Mon 05:35:24:573.247 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-04 Mon 05:35:24:573.272 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-04 Mon 05:35:24:573.294 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-04 Mon 05:35:24:573.318 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-04 Mon 05:35:24:573.339 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-04 Mon 05:35:24:573.360 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-04 Mon 05:35:24:573.381 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-04 Mon 05:35:24:573.080 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990571185920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-08-04 Mon 05:35:24:573.533 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990571185920, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-08-04 Mon 05:35:24:573.555 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990571185920, Pid 1]: SANDESH: Send FAILED: 1754285724572897  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3751-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  ] ] status = Up description = 10.0.0.254:6379::Down.10.0.0.50:6379::Down. ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-08-04 Mon 05:35:24:573.566 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990571185920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-08-04 Mon 05:35:24:573.575 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990571185920, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-08-04 Mon 05:35:24:573.592 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990571185920, Pid 1]: SANDESH: Send FAILED: 1754285724572999  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3751-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  ] ] status = Up description = 10.0.0.254:6379::Down. ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-08-04 Mon 05:35:24:573.599 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990571185920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-08-04 Mon 05:35:24:573.608 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990571185920, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-08-04 Mon 05:35:24:573.625 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990571185920, Pid 1]: SANDESH: Send FAILED: 1754285724573311  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3751-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-08-04 Mon 05:35:24:573.632 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990571185920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-08-04 Mon 05:35:25:571.718 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990352774912, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle
2025-08-04 Mon 05:35:25:571.955 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990352774912, Pid 1]: Connect : Start Connect timer 10.0.0.50:8086
2025-08-04 Mon 05:35:25:572.102 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990352774912, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-08-04 Mon 05:35:25:572.142 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990352774912, Pid 1]: SANDESH: Send FAILED: 1754285725571807  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3751-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.50:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-08-04 Mon 05:35:25:572.163 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990352774912, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-08-04 Mon 05:35:25:572.176 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990352774912, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-08-04 Mon 05:35:25:572.380 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990352774912, Pid 1]: SANDESH: Send FAILED: 1754285725572084  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3751-1.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1754285683926345 collector_name =  collector_ip = 10.0.0.50:8086 collector_list= [  [ (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 86,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 16,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-08-04 Mon 05:35:25:572.400 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990352774912, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-08-04 Mon 05:35:25:574.113 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.254:58352::10.0.0.50:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280
2025-08-04 Mon 05:35:25:574.141 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: 10.0.0.254:58352::10.0.0.50:8086(-1) OnSessionEvent TCP Connected
2025-08-04 Mon 05:35:25:574.150 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: 10.0.0.254:58352::10.0.0.50:8086(-1):EvTcpConnected
2025-08-04 Mon 05:35:25:574.221 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990575384320, Pid 1]: Processing scm::EvTcpConnected in state Connect
2025-08-04 Mon 05:35:25:574.256 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990575384320, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer
2025-08-04 Mon 05:35:25:574.300 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990575384320, Pid 1]: ClientInit
2025-08-04 Mon 05:35:25:574.324 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990575384320, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-3751-1.:contrail-query-engine:0:Database count 1
2025-08-04 Mon 05:35:25:574.444 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990575384320, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2025-08-04 Mon 05:35:25:574.457 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990575384320, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE
2025-08-04 Mon 05:35:25:574.490 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990575384320, Pid 1]: SANDESH: Send FAILED: 1754285725574292  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3751-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.50:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-08-04 Mon 05:35:25:574.501 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990575384320, Pid 1]: Received UVE message in wrong state : NodeStatusUVE
2025-08-04 Mon 05:35:25:574.520 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990575384320, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2025-08-04 Mon 05:35:25:574.530 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990575384320, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer
2025-08-04 Mon 05:35:25:574.545 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990575384320, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2025-08-04 Mon 05:35:25:574.554 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990575384320, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace
2025-08-04 Mon 05:35:25:574.751 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990575384320, Pid 1]: SANDESH: Send FAILED: 1754285725574429  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3751-1.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1754285683926345 collector_name =  collector_ip = 10.0.0.50:8086 collector_list= [  [ (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 87,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-08-04 Mon 05:35:25:574.770 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990575384320, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace
2025-08-04 Mon 05:35:25:576.081 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: OnMessage control in state: ClientInit
2025-08-04 Mon 05:35:25:576.126 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: Processing scm::EvSandeshMessageRecv in state ClientInit
2025-08-04 Mon 05:35:25:576.139 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: ClientInit : EvSandeshMessageRecv
2025-08-04 Mon 05:35:25:576.170 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: Received Ctrl Message with size 0
2025-08-04 Mon 05:35:25:576.412 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-3751-1.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1754285683926345 collector_name =  collector_ip = 10.0.0.50:8086 collector_list= [  [ (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 14 dequeues = 14 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1754285724571568 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1754285724571925 ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 87,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18,  _iter59->first = sent _iter59->second = 0,  ] ] max_sm_queue_count = 5 proxy  seq 10
2025-08-04 Mon 05:35:25:576.441 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1
2025-08-04 Mon 05:35:25:576.474 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: SyncUVE Syncing ObjectDatabaseInfo val name = cn-jenkins-deploy-platform-ansible-os-3751-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.50:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] proxy  seq 11
2025-08-04 Mon 05:35:25:576.494 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1
2025-08-04 Mon 05:35:25:576.505 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 without seqno , total = 0
2025-08-04 Mon 05:35:25:576.515 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0
2025-08-04 Mon 05:35:25:576.551 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: Established
2025-08-04 Mon 05:35:35:245.467 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990340179712, Pid 1]: OnMessage control in state: Established
2025-08-04 Mon 05:35:35:245.535 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990340179712, Pid 1]: Processing scm::EvSandeshMessageRecv in state Established
2025-08-04 Mon 05:35:35:245.546 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990340179712, Pid 1]: Established : EvSandeshMessageRecv
2025-08-04 Mon 05:35:35:245.589 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990340179712, Pid 1]: Received Ctrl Message with size 3
2025-08-04 Mon 05:35:35:245.603 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990340179712, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 with seqno 11, total = 0
2025-08-04 Mon 05:35:35:245.613 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990340179712, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 with seqno 13, total = 0
2025-08-04 Mon 05:35:35:245.626 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990340179712, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 with seqno 1, total = 0
2025-08-04 Mon 05:35:35:245.634 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990340179712, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0
2025-08-04 Mon 05:35:54:572.311 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990356973312, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 1 without seqno , total = 0
2025-08-04 Mon 05:36:54:572.828 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990579582720, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 2 without seqno , total = 0
2025-08-04 Mon 05:37:35:047.811 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.254:8091::10.0.0.254:49940 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254
2025-08-04 Mon 05:37:54:573.956 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990365370112, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 3 without seqno , total = 0
2025-08-04 Mon 05:38:13:433.775 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.254:8091::10.0.0.254:59256 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254
2025-08-04 Mon 05:38:54:575.121 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990344378112, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 4 without seqno , total = 0
2025-08-04 Mon 05:39:19:930.045 UTC  cn-jenkins-deploy-platform-ansible-os-3751-1 [Thread 139990731651200, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.254:8091::10.0.0.254:37770 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254