2025-05-22 Thu 01:21:42:317.269 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: http-server-port 8091
2025-05-22 Thu 01:21:42:317.362 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: Max-tasks 16
2025-05-22 Thu 01:21:42:317.371 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: Max-slice 100
2025-05-22 Thu 01:21:42:317.377 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: Collectors  10.0.0.19:8086
2025-05-22 Thu 01:21:42:317.382 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: Collectors  10.0.0.41:8086
2025-05-22 Thu 01:21:42:317.387 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: Collectors  10.0.0.61:8086
2025-05-22 Thu 01:21:42:317.407 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: SANDESH: ROLE             : Generator
2025-05-22 Thu 01:21:42:317.413 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: SANDESH: MODULE           : contrail-query-engine
2025-05-22 Thu 01:21:42:317.419 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: SANDESH: SOURCE           : cn-jenkins-deploy-platform-ansible-os-3329-3.
2025-05-22 Thu 01:21:42:317.424 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: SANDESH: NODE TYPE        : Database
2025-05-22 Thu 01:21:42:317.429 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: SANDESH: INSTANCE ID      : 0
2025-05-22 Thu 01:21:42:317.435 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: SANDESH: HTTP SERVER PORT : 8091
2025-05-22 Thu 01:21:42:317.441 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: SANDESH: System Log Send Rate Limit: 0 -> 0
2025-05-22 Thu 01:21:42:318.070 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: HTTP Introspect Init
2025-05-22 Thu 01:21:42:318.185 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8091  Initialization complete src/contrail-common/io/tcp_server.cc 137
2025-05-22 Thu 01:21:42:318.245 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: Sandesh Http Server Port: 8091
2025-05-22 Thu 01:21:42:318.284 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: SANDESH: NOT Writing http_port 8091TO : /tmp/contrail-query-engine.0.http_port
2025-05-22 Thu 01:21:42:318.293 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: SANDESH: CONNECT TO COLLECTOR: 1
2025-05-22 Thu 01:21:42:318.375 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: Idle
2025-05-22 Thu 01:21:42:318.643 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: SANDESH: No Client: 1747876902318561  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3329-3.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1747876902318385 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 0,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-05-22 Thu 01:21:42:318.787 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: SANDESH: Logging: DISABLED -> ENABLED
2025-05-22 Thu 01:21:42:318.802 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ]
2025-05-22 Thu 01:21:42:318.815 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: Cassandra Servers: 10.0.0.19:9042 10.0.0.41:9042 10.0.0.61:9042 
2025-05-22 Thu 01:21:42:319.445 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744111990528, Pid 1]: Processing scm::EvStart in state Idle
2025-05-22 Thu 01:21:42:319.536 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744111990528, Pid 1]: Disconnect
2025-05-22 Thu 01:21:42:319.622 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744111990528, Pid 1]: Processing scm::EvCollectorUpdate in state Disconnect
2025-05-22 Thu 01:21:42:319.837 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744111990528, Pid 1]: Connect : Start Connect timer 10.0.0.19:8086
2025-05-22 Thu 01:21:42:319.930 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744111990528, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-05-22 Thu 01:21:42:319.954 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744111990528, Pid 1]: SANDESH: Send FAILED: 1747876902319526  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3329-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Idle : EvStart -> Disconnect ],  ] ] flag_infos= [  [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ],  ] ] ]
2025-05-22 Thu 01:21:42:319.964 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744111990528, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-05-22 Thu 01:21:42:319.973 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744111990528, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-05-22 Thu 01:21:42:320.062 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744111990528, Pid 1]: SANDESH: Send FAILED: 1747876902319605  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3329-3.:Database:contrail-query-engine:0 client_info= [  status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1747876902318385 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-05-22 Thu 01:21:42:320.081 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744111990528, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-05-22 Thu 01:21:42:320.091 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744111990528, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-05-22 Thu 01:21:42:320.170 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744111990528, Pid 1]: SANDESH: Send FAILED: 1747876902319675  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3329-3.:Database:contrail-query-engine:0 client_info= [  status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1747876902318385 collector_name =  collector_ip = 10.0.0.19:8086 collector_list= [  [ (*_iter40) = 10.0.0.19:8086,  (*_iter40) = 10.0.0.61:8086,  (*_iter40) = 10.0.0.41:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-05-22 Thu 01:21:42:320.183 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744111990528, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-05-22 Thu 01:21:42:320.192 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744111990528, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-05-22 Thu 01:21:42:320.208 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744111990528, Pid 1]: SANDESH: Send FAILED: 1747876902319702  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3329-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.19:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  ] ] flag_infos= [  [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ],  ] ] ]
2025-05-22 Thu 01:21:42:320.215 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744111990528, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-05-22 Thu 01:21:42:320.223 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744111990528, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-05-22 Thu 01:21:42:320.294 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744111990528, Pid 1]: SANDESH: Send FAILED: 1747876902319914  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3329-3.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1747876902318385 collector_name =  collector_ip = 10.0.0.19:8086 collector_list= [  [ (*_iter40) = 10.0.0.19:8086,  (*_iter40) = 10.0.0.61:8086,  (*_iter40) = 10.0.0.41:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-05-22 Thu 01:21:42:320.306 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744111990528, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-05-22 Thu 01:21:42:325.940 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-05-22 Thu 01:21:42:325.969 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-05-22 Thu 01:21:42:326.078 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744111990528, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-05-22 Thu 01:21:42:326.136 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744111990528, Pid 1]: SANDESH: Send FAILED: 1747876902326006  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3329-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.19:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.19:9042,  (*_iter6) = 10.0.0.41:9042,  (*_iter6) = 10.0.0.61:9042,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2025-05-22 Thu 01:21:42:326.149 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744111990528, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-05-22 Thu 01:21:42:326.398 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 0 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-05-22 Thu 01:21:47:328.990 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-05-22 Thu 01:21:47:329.028 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-05-22 Thu 01:21:47:329.063 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 1 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-05-22 Thu 01:21:52:338.101 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-05-22 Thu 01:21:52:338.147 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-05-22 Thu 01:21:52:338.171 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 2 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-05-22 Thu 01:21:57:339.636 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-05-22 Thu 01:21:57:339.679 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-05-22 Thu 01:21:57:339.703 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 3 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-05-22 Thu 01:22:02:421.762 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004
2025-05-22 Thu 01:22:02:421.810 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-05-22 Thu 01:22:02:421.834 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 4 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-05-22 Thu 01:22:07:636.139 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004
2025-05-22 Thu 01:22:07:636.191 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-05-22 Thu 01:22:07:636.214 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 5 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-05-22 Thu 01:22:12:683.637 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004
2025-05-22 Thu 01:22:12:683.683 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-05-22 Thu 01:22:12:683.706 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 6 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-05-22 Thu 01:22:17:729.595 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-05-22 Thu 01:22:17:729.658 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 7 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-05-22 Thu 01:22:22:752.602 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: Older table does not exist. will query only the new table src/contrail-analytics/contrail-query-engine/query.cc 1037
2025-05-22 Thu 01:22:27:763.654 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743845127936, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-05-22 Thu 01:22:27:763.702 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: -(-1) OnSessionEvent TCP Connect Failed
2025-05-22 Thu 01:22:27:763.741 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: -(-1):EvTcpConnectFail
2025-05-22 Thu 01:22:27:763.761 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: RAC_Connect status: 0 0x24af5f0
2025-05-22 Thu 01:22:27:763.768 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: Connected to REDIS...

2025-05-22 Thu 01:22:27:763.725 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743845127936, Pid 1]: SANDESH: Send FAILED: 1747876947763571  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3329-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.19:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.19:9042,  (*_iter6) = 10.0.0.41:9042,  (*_iter6) = 10.0.0.61:9042,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2025-05-22 Thu 01:22:27:763.791 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.19 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-05-22 Thu 01:22:27:763.797 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743845127936, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-05-22 Thu 01:22:27:763.810 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: RAC_Connect status: 0 0x24afca0
2025-05-22 Thu 01:22:27:763.819 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743845127936, Pid 1]: Processing scm::EvTcpConnectFail in state Connect
2025-05-22 Thu 01:22:27:763.834 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743845127936, Pid 1]: Connect : EvTcpConnectFail
2025-05-22 Thu 01:22:27:763.819 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: Connected to REDIS...

2025-05-22 Thu 01:22:27:763.860 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.19 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-05-22 Thu 01:22:27:763.872 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: RAC_Connect status: 0 0x24a91d0
2025-05-22 Thu 01:22:27:763.878 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: Connected to REDIS...

2025-05-22 Thu 01:22:27:763.887 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.19 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-05-22 Thu 01:22:27:763.897 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: RAC_Connect status: 0 0x24b0340
2025-05-22 Thu 01:22:27:763.903 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: Connected to REDIS...

2025-05-22 Thu 01:22:27:763.922 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.19 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-05-22 Thu 01:22:27:763.933 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: RAC_Connect status: 0 0x24b0870
2025-05-22 Thu 01:22:27:763.938 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: Connected to REDIS...

2025-05-22 Thu 01:22:27:763.948 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.19 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-05-22 Thu 01:22:27:763.958 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: RAC_Connect status: 0 0x24b3fe0
2025-05-22 Thu 01:22:27:763.964 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: Connected to REDIS...

2025-05-22 Thu 01:22:27:763.973 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.61 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-05-22 Thu 01:22:27:763.981 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743845127936, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312
2025-05-22 Thu 01:22:27:763.982 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: RAC_Connect status: 0 0x24b4920
2025-05-22 Thu 01:22:27:764.006 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: Connected to REDIS...

2025-05-22 Thu 01:22:27:764.014 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.61 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-05-22 Thu 01:22:27:764.023 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: RAC_Connect status: 0 0x24b11a0
2025-05-22 Thu 01:22:27:764.029 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: Connected to REDIS...

2025-05-22 Thu 01:22:27:764.031 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743845127936, Pid 1]: Idle
2025-05-22 Thu 01:22:27:764.039 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.41 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-05-22 Thu 01:22:27:764.063 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: RAC_Connect status: 0 0x24b5260
2025-05-22 Thu 01:22:27:764.069 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: Connected to REDIS...

2025-05-22 Thu 01:22:27:764.078 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.61 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-05-22 Thu 01:22:27:764.088 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: RAC_Connect status: 0 0x24b5ba0
2025-05-22 Thu 01:22:27:764.094 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: Connected to REDIS...

2025-05-22 Thu 01:22:27:764.103 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.61 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-05-22 Thu 01:22:27:764.113 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: RAC_Connect status: 0 0x24b1ae0
2025-05-22 Thu 01:22:27:764.118 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: Connected to REDIS...

2025-05-22 Thu 01:22:27:764.119 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743845127936, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-05-22 Thu 01:22:27:764.135 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.41 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-05-22 Thu 01:22:27:764.161 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: RAC_Connect status: 0 0x24b2d60
2025-05-22 Thu 01:22:27:764.166 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: Connected to REDIS...

2025-05-22 Thu 01:22:27:764.178 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.41 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-05-22 Thu 01:22:27:764.188 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: RAC_Connect status: 0 0x24b64e0
2025-05-22 Thu 01:22:27:764.193 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: Connected to REDIS...

2025-05-22 Thu 01:22:27:764.204 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.61 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-05-22 Thu 01:22:27:764.214 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: RAC_Connect status: 0 0x24b2420
2025-05-22 Thu 01:22:27:764.219 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: Connected to REDIS...

2025-05-22 Thu 01:22:27:764.228 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.41 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-05-22 Thu 01:22:27:764.237 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: RAC_Connect status: 0 0x24b36a0
2025-05-22 Thu 01:22:27:764.243 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: Connected to REDIS...

2025-05-22 Thu 01:22:27:764.253 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.41 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-05-22 Thu 01:22:27:764.267 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743845127936, Pid 1]: SANDESH: Send FAILED: 1747876947763927  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3329-3.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1747876902318385 collector_name =  collector_ip = 10.0.0.61:8086 collector_list= [  [ (*_iter40) = 10.0.0.19:8086,  (*_iter40) = 10.0.0.61:8086,  (*_iter40) = 10.0.0.41:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 27 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 28,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-05-22 Thu 01:22:27:764.298 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743845127936, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-05-22 Thu 01:22:27:764.310 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743845127936, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-05-22 Thu 01:22:27:764.332 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743845127936, Pid 1]: SANDESH: Send FAILED: 1747876947763957  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3329-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.19:9042,  (*_iter6) = 10.0.0.41:9042,  (*_iter6) = 10.0.0.61:9042,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2025-05-22 Thu 01:22:27:764.340 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743845127936, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-05-22 Thu 01:22:27:764.349 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743845127936, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle
2025-05-22 Thu 01:22:27:764.390 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743845127936, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-05-22 Thu 01:22:27:764.557 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.61:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-05-22 Thu 01:22:27:764.573 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743845127936, Pid 1]: SANDESH: Send FAILED: 1747876947764107  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3329-3.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1747876902318385 collector_name =  collector_ip = 10.0.0.61:8086 collector_list= [  [ (*_iter40) = 10.0.0.19:8086,  (*_iter40) = 10.0.0.61:8086,  (*_iter40) = 10.0.0.41:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 33 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 35,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-05-22 Thu 01:22:27:764.595 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743845127936, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-05-22 Thu 01:22:27:764.575 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.61:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-05-22 Thu 01:22:27:764.786 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744116188928, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-05-22 Thu 01:22:27:764.860 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744116188928, Pid 1]: SANDESH: Send FAILED: 1747876947764676  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3329-3.:Database:contrail-query-engine:0 sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 14 dequeues = 14 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1747876947764030 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1747876947764389 ] max_sm_queue_count = 5 ]
2025-05-22 Thu 01:22:27:764.871 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744116188928, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-05-22 Thu 01:22:27:764.882 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744116188928, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-05-22 Thu 01:22:27:764.908 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744116188928, Pid 1]: SANDESH: Send FAILED: 1747876947764713  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3329-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.19:9042,  (*_iter6) = 10.0.0.41:9042,  (*_iter6) = 10.0.0.61:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.19:6379,  (*_iter6) = 10.0.0.41:6379,  (*_iter6) = 10.0.0.61:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2025-05-22 Thu 01:22:27:764.916 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744116188928, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-05-22 Thu 01:22:27:764.936 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744116188928, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-05-22 Thu 01:22:27:765.086 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744116188928, Pid 1]: SANDESH: Send FAILED: 1747876947764743  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3329-3.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1747876902318385 collector_name =  collector_ip = 10.0.0.61:8086 collector_list= [  [ (*_iter40) = 10.0.0.19:8086,  (*_iter40) = 10.0.0.61:8086,  (*_iter40) = 10.0.0.41:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 41 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 43,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-05-22 Thu 01:22:27:765.102 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744116188928, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-05-22 Thu 01:22:27:765.271 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-05-22 Thu 01:22:27:765.316 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.19:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-05-22 Thu 01:22:27:765.329 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.19:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-05-22 Thu 01:22:27:765.345 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.61:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-05-22 Thu 01:22:27:765.355 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.61:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-05-22 Thu 01:22:27:765.369 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.61:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-05-22 Thu 01:22:27:765.379 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.61:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-05-22 Thu 01:22:27:765.392 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.61:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-05-22 Thu 01:22:27:765.402 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.61:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-05-22 Thu 01:22:27:765.414 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.61:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-05-22 Thu 01:22:27:765.424 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.61:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-05-22 Thu 01:22:27:765.437 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.19:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-05-22 Thu 01:22:27:765.446 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.19:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-05-22 Thu 01:22:27:765.481 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.19:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-05-22 Thu 01:22:27:765.492 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.19:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-05-22 Thu 01:22:27:765.505 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.19:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-05-22 Thu 01:22:27:765.515 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.19:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-05-22 Thu 01:22:27:765.528 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.19:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-05-22 Thu 01:22:27:765.538 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.19:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-05-22 Thu 01:22:27:765.601 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-05-22 Thu 01:22:27:765.628 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744099395328, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-05-22 Thu 01:22:27:765.669 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744099395328, Pid 1]: SANDESH: Send FAILED: 1747876947765573  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3329-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.19:9042,  (*_iter6) = 10.0.0.41:9042,  (*_iter6) = 10.0.0.61:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.19:6379,  (*_iter6) = 10.0.0.41:6379,  (*_iter6) = 10.0.0.61:6379,  ] ] status = Up description = 10.0.0.19:6379::Down.10.0.0.41:6379::Down. ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-05-22 Thu 01:22:27:765.678 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744099395328, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-05-22 Thu 01:22:27:765.634 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-05-22 Thu 01:22:27:765.713 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-05-22 Thu 01:22:27:765.730 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-05-22 Thu 01:22:27:765.745 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-05-22 Thu 01:22:27:765.770 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-05-22 Thu 01:22:27:765.791 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-05-22 Thu 01:22:27:765.807 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-05-22 Thu 01:22:27:765.822 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-05-22 Thu 01:22:27:765.841 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.41:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-05-22 Thu 01:22:27:765.851 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.41:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-05-22 Thu 01:22:27:765.865 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.41:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-05-22 Thu 01:22:27:765.875 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.41:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-05-22 Thu 01:22:27:765.888 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.41:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-05-22 Thu 01:22:27:765.898 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.41:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-05-22 Thu 01:22:27:765.911 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.41:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-05-22 Thu 01:22:27:765.920 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.41:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-05-22 Thu 01:22:27:765.933 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.41:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-05-22 Thu 01:22:27:765.942 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.41:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-05-22 Thu 01:22:27:765.981 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-05-22 Thu 01:22:27:766.009 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-05-22 Thu 01:22:27:766.025 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-05-22 Thu 01:22:27:766.056 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-05-22 Thu 01:22:27:766.075 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-05-22 Thu 01:22:27:765.692 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744099395328, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-05-22 Thu 01:22:27:766.139 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744099395328, Pid 1]: SANDESH: Send FAILED: 1747876947765626  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3329-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.19:9042,  (*_iter6) = 10.0.0.41:9042,  (*_iter6) = 10.0.0.61:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.19:6379,  (*_iter6) = 10.0.0.41:6379,  (*_iter6) = 10.0.0.61:6379,  ] ] status = Up description = 10.0.0.41:6379::Down. ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-05-22 Thu 01:22:27:766.147 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744099395328, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-05-22 Thu 01:22:27:766.157 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744099395328, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-05-22 Thu 01:22:27:766.177 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744099395328, Pid 1]: SANDESH: Send FAILED: 1747876947766002  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3329-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.19:9042,  (*_iter6) = 10.0.0.41:9042,  (*_iter6) = 10.0.0.61:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.19:6379,  (*_iter6) = 10.0.0.41:6379,  (*_iter6) = 10.0.0.61:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-05-22 Thu 01:22:27:766.184 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744099395328, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-05-22 Thu 01:22:28:764.200 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744107792128, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle
2025-05-22 Thu 01:22:28:764.492 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744107792128, Pid 1]: Connect : Start Connect timer 10.0.0.61:8086
2025-05-22 Thu 01:22:28:764.675 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744107792128, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-05-22 Thu 01:22:28:764.726 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744107792128, Pid 1]: SANDESH: Send FAILED: 1747876948764278  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3329-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.61:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.19:9042,  (*_iter6) = 10.0.0.41:9042,  (*_iter6) = 10.0.0.61:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.19:6379,  (*_iter6) = 10.0.0.41:6379,  (*_iter6) = 10.0.0.61:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-05-22 Thu 01:22:28:764.746 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744107792128, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-05-22 Thu 01:22:28:764.757 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744107792128, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-05-22 Thu 01:22:28:764.897 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744107792128, Pid 1]: SANDESH: Send FAILED: 1747876948764648  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3329-3.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1747876902318385 collector_name =  collector_ip = 10.0.0.61:8086 collector_list= [  [ (*_iter40) = 10.0.0.19:8086,  (*_iter40) = 10.0.0.61:8086,  (*_iter40) = 10.0.0.41:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 86,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 16,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-05-22 Thu 01:22:28:764.916 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744107792128, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-05-22 Thu 01:22:28:766.764 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.61:59352::10.0.0.61:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280
2025-05-22 Thu 01:22:28:791.475 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: 10.0.0.61:59352::10.0.0.61:8086(-1) OnSessionEvent TCP Connected
2025-05-22 Thu 01:22:28:791.497 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: 10.0.0.61:59352::10.0.0.61:8086(-1):EvTcpConnected
2025-05-22 Thu 01:22:28:791.583 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744099395328, Pid 1]: Processing scm::EvTcpConnected in state Connect
2025-05-22 Thu 01:22:28:791.608 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744099395328, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer
2025-05-22 Thu 01:22:28:791.653 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744099395328, Pid 1]: ClientInit
2025-05-22 Thu 01:22:28:791.677 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744099395328, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-3329-3.:contrail-query-engine:0:Database count 1
2025-05-22 Thu 01:22:28:791.787 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744099395328, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2025-05-22 Thu 01:22:28:791.797 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744099395328, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE
2025-05-22 Thu 01:22:28:791.823 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744099395328, Pid 1]: SANDESH: Send FAILED: 1747876948791645  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3329-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.61:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.19:9042,  (*_iter6) = 10.0.0.41:9042,  (*_iter6) = 10.0.0.61:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.19:6379,  (*_iter6) = 10.0.0.41:6379,  (*_iter6) = 10.0.0.61:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-05-22 Thu 01:22:28:791.832 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744099395328, Pid 1]: Received UVE message in wrong state : NodeStatusUVE
2025-05-22 Thu 01:22:28:791.851 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744099395328, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2025-05-22 Thu 01:22:28:791.858 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744099395328, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer
2025-05-22 Thu 01:22:28:791.870 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744099395328, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2025-05-22 Thu 01:22:28:791.877 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744099395328, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace
2025-05-22 Thu 01:22:28:792.002 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744099395328, Pid 1]: SANDESH: Send FAILED: 1747876948791771  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3329-3.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1747876902318385 collector_name =  collector_ip = 10.0.0.61:8086 collector_list= [  [ (*_iter40) = 10.0.0.19:8086,  (*_iter40) = 10.0.0.61:8086,  (*_iter40) = 10.0.0.41:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 87,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-05-22 Thu 01:22:28:792.019 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744099395328, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace
2025-05-22 Thu 01:22:28:883.788 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743853520640, Pid 1]: OnMessage control in state: ClientInit
2025-05-22 Thu 01:22:28:883.845 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743853520640, Pid 1]: Processing scm::EvSandeshMessageRecv in state ClientInit
2025-05-22 Thu 01:22:28:883.857 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743853520640, Pid 1]: ClientInit : EvSandeshMessageRecv
2025-05-22 Thu 01:22:28:883.893 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743853520640, Pid 1]: Received Ctrl Message with size 0
2025-05-22 Thu 01:22:28:884.069 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743853520640, Pid 1]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-3329-3.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1747876902318385 collector_name =  collector_ip = 10.0.0.61:8086 collector_list= [  [ (*_iter40) = 10.0.0.19:8086,  (*_iter40) = 10.0.0.61:8086,  (*_iter40) = 10.0.0.41:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 14 dequeues = 14 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1747876947764030 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1747876947764389 ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 87,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18,  _iter59->first = sent _iter59->second = 0,  ] ] max_sm_queue_count = 5 proxy  seq 10
2025-05-22 Thu 01:22:28:884.098 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743853520640, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1
2025-05-22 Thu 01:22:28:884.126 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743853520640, Pid 1]: SyncUVE Syncing ObjectDatabaseInfo val name = cn-jenkins-deploy-platform-ansible-os-3329-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.61:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.19:9042,  (*_iter6) = 10.0.0.41:9042,  (*_iter6) = 10.0.0.61:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.19:6379,  (*_iter6) = 10.0.0.41:6379,  (*_iter6) = 10.0.0.61:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] proxy  seq 11
2025-05-22 Thu 01:22:28:884.141 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743853520640, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1
2025-05-22 Thu 01:22:28:884.150 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743853520640, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 without seqno , total = 0
2025-05-22 Thu 01:22:28:884.157 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743853520640, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0
2025-05-22 Thu 01:22:28:884.191 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743853520640, Pid 1]: Established
2025-05-22 Thu 01:22:34:689.481 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743845127936, Pid 1]: OnMessage control in state: Established
2025-05-22 Thu 01:22:34:689.540 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743845127936, Pid 1]: Processing scm::EvSandeshMessageRecv in state Established
2025-05-22 Thu 01:22:34:689.551 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743845127936, Pid 1]: Established : EvSandeshMessageRecv
2025-05-22 Thu 01:22:34:689.598 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743845127936, Pid 1]: Received Ctrl Message with size 3
2025-05-22 Thu 01:22:34:689.613 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743845127936, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 with seqno 11, total = 0
2025-05-22 Thu 01:22:34:689.624 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743845127936, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 with seqno 13, total = 0
2025-05-22 Thu 01:22:34:689.636 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743845127936, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 with seqno 1, total = 0
2025-05-22 Thu 01:22:34:689.644 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743845127936, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0
2025-05-22 Thu 01:22:57:765.903 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743866115840, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 1 without seqno , total = 0
2025-05-22 Thu 01:23:57:767.546 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743861917440, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 2 without seqno , total = 0
2025-05-22 Thu 01:24:57:768.757 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744116188928, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 3 without seqno , total = 0
2025-05-22 Thu 01:25:27:047.480 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.61:8091::10.0.0.61:47940 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254
2025-05-22 Thu 01:25:38:841.466 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.61:8091::10.0.0.61:50326 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254
2025-05-22 Thu 01:25:57:769.847 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743853520640, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 4 without seqno , total = 0
2025-05-22 Thu 01:26:57:771.026 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744095196928, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 5 without seqno , total = 0
2025-05-22 Thu 01:27:57:771.629 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743845127936, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 6 without seqno , total = 0
2025-05-22 Thu 01:28:57:772.275 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743874512640, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 7 without seqno , total = 0
2025-05-22 Thu 01:29:57:772.970 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743853520640, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 8 without seqno , total = 0
2025-05-22 Thu 01:30:57:773.688 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744111990528, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 9 without seqno , total = 0
2025-05-22 Thu 01:31:57:774.761 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743861917440, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 10 without seqno , total = 0
2025-05-22 Thu 01:32:57:775.503 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744081938176, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 11 without seqno , total = 0
2025-05-22 Thu 01:33:57:776.585 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139743845127936, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 12 without seqno , total = 0
2025-05-22 Thu 01:34:57:777.818 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744116188928, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 13 without seqno , total = 0
2025-05-22 Thu 01:35:57:778.370 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744103593728, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 14 without seqno , total = 0
2025-05-22 Thu 01:36:54:236.240 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744259860608, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.61:8091::10.0.0.61:46994 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254
2025-05-22 Thu 01:36:57:779.151 UTC  cn-jenkins-deploy-platform-ansible-os-3329-3 [Thread 139744103593728, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 15 without seqno , total = 0