2025-09-29 Mon 04:58:08:705.536 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: http-server-port 8091
2025-09-29 Mon 04:58:08:705.661 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: Max-tasks 16
2025-09-29 Mon 04:58:08:705.672 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: Max-slice 100
2025-09-29 Mon 04:58:08:705.678 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: Collectors  10.0.0.254:8086
2025-09-29 Mon 04:58:08:705.683 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: Collectors  10.0.0.38:8086
2025-09-29 Mon 04:58:08:705.688 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: Collectors  10.0.0.48:8086
2025-09-29 Mon 04:58:08:705.723 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: SANDESH: ROLE             : Generator
2025-09-29 Mon 04:58:08:705.730 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: SANDESH: MODULE           : contrail-query-engine
2025-09-29 Mon 04:58:08:705.736 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: SANDESH: SOURCE           : cn-jenkins-deploy-platform-ansible-os-4204-3.
2025-09-29 Mon 04:58:08:705.741 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: SANDESH: NODE TYPE        : Database
2025-09-29 Mon 04:58:08:705.747 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: SANDESH: INSTANCE ID      : 0
2025-09-29 Mon 04:58:08:705.752 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: SANDESH: HTTP SERVER PORT : 8091
2025-09-29 Mon 04:58:08:705.758 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: SANDESH: System Log Send Rate Limit: 0 -> 0
2025-09-29 Mon 04:58:08:706.451 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: HTTP Introspect Init
2025-09-29 Mon 04:58:08:706.587 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8091  Initialization complete src/contrail-common/io/tcp_server.cc 137
2025-09-29 Mon 04:58:08:706.665 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: Sandesh Http Server Port: 8091
2025-09-29 Mon 04:58:08:706.720 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: SANDESH: NOT Writing http_port 8091TO : /tmp/contrail-query-engine.0.http_port
2025-09-29 Mon 04:58:08:706.730 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: SANDESH: CONNECT TO COLLECTOR: 1
2025-09-29 Mon 04:58:08:706.821 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: Idle
2025-09-29 Mon 04:58:08:707.039 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: SANDESH: No Client: 1759121888706939  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4204-3.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1759121888706833 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 0,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-09-29 Mon 04:58:08:707.193 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: SANDESH: Logging: DISABLED -> ENABLED
2025-09-29 Mon 04:58:08:707.227 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ]
2025-09-29 Mon 04:58:08:707.240 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: Cassandra Servers: 10.0.0.254:9042 10.0.0.38:9042 10.0.0.48:9042 
2025-09-29 Mon 04:58:08:707.291 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190342244096, Pid 1]: Processing scm::EvStart in state Idle
2025-09-29 Mon 04:58:08:707.361 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190342244096, Pid 1]: Disconnect
2025-09-29 Mon 04:58:08:707.431 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190342244096, Pid 1]: Processing scm::EvCollectorUpdate in state Disconnect
2025-09-29 Mon 04:58:08:707.625 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190342244096, Pid 1]: Connect : Start Connect timer 10.0.0.254:8086
2025-09-29 Mon 04:58:08:707.693 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190342244096, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-09-29 Mon 04:58:08:707.714 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190342244096, Pid 1]: SANDESH: Send FAILED: 1759121888707353  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4204-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Idle : EvStart -> Disconnect ],  ] ] flag_infos= [  [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ],  ] ] ]
2025-09-29 Mon 04:58:08:707.723 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190342244096, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-09-29 Mon 04:58:08:707.732 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190342244096, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-09-29 Mon 04:58:08:707.811 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190342244096, Pid 1]: SANDESH: Send FAILED: 1759121888707420  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4204-3.:Database:contrail-query-engine:0 client_info= [  status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1759121888706833 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-09-29 Mon 04:58:08:707.828 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190342244096, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-09-29 Mon 04:58:08:707.837 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190342244096, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-09-29 Mon 04:58:08:707.905 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190342244096, Pid 1]: SANDESH: Send FAILED: 1759121888707478  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4204-3.:Database:contrail-query-engine:0 client_info= [  status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1759121888706833 collector_name =  collector_ip = 10.0.0.254:8086 collector_list= [  [ (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.38:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-09-29 Mon 04:58:08:707.917 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190342244096, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-09-29 Mon 04:58:08:707.926 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190342244096, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-09-29 Mon 04:58:08:707.941 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190342244096, Pid 1]: SANDESH: Send FAILED: 1759121888707498  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4204-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  ] ] flag_infos= [  [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ],  ] ] ]
2025-09-29 Mon 04:58:08:707.957 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190342244096, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-09-29 Mon 04:58:08:707.965 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190342244096, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-09-29 Mon 04:58:08:708.026 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190342244096, Pid 1]: SANDESH: Send FAILED: 1759121888707681  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4204-3.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1759121888706833 collector_name =  collector_ip = 10.0.0.254:8086 collector_list= [  [ (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.38:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-09-29 Mon 04:58:08:708.038 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190342244096, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-09-29 Mon 04:58:08:713.897 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-09-29 Mon 04:58:08:713.923 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-09-29 Mon 04:58:08:713.984 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 0 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-09-29 Mon 04:58:08:717.289 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190338045696, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-09-29 Mon 04:58:08:717.345 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190338045696, Pid 1]: SANDESH: Send FAILED: 1759121888713962  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4204-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2025-09-29 Mon 04:58:08:717.358 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190338045696, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-09-29 Mon 04:58:13:716.678 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-09-29 Mon 04:58:13:716.720 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-09-29 Mon 04:58:13:716.760 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 1 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-09-29 Mon 04:58:18:718.489 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-09-29 Mon 04:58:18:718.533 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-09-29 Mon 04:58:18:718.555 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 2 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-09-29 Mon 04:58:23:720.442 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-09-29 Mon 04:58:23:720.488 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-09-29 Mon 04:58:23:720.511 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 3 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-09-29 Mon 04:58:28:838.447 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004
2025-09-29 Mon 04:58:28:838.499 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-09-29 Mon 04:58:28:838.525 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 4 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-09-29 Mon 04:58:33:867.385 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004
2025-09-29 Mon 04:58:33:867.434 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-09-29 Mon 04:58:33:867.456 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 5 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-09-29 Mon 04:58:38:894.069 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004
2025-09-29 Mon 04:58:38:894.117 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-09-29 Mon 04:58:38:894.148 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 6 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-09-29 Mon 04:58:43:916.414 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: Older table does not exist. will query only the new table src/contrail-analytics/contrail-query-engine/query.cc 1037
2025-09-29 Mon 04:58:43:916.473 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 7 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-09-29 Mon 04:58:48:937.046 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: Older table does not exist. will query only the new table src/contrail-analytics/contrail-query-engine/query.cc 1037
2025-09-29 Mon 04:58:48:943.880 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: -(-1) OnSessionEvent TCP Connect Failed
2025-09-29 Mon 04:58:48:943.906 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: -(-1):EvTcpConnectFail
2025-09-29 Mon 04:58:48:943.924 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: RAC_Connect status: 0 0x108b5f0
2025-09-29 Mon 04:58:48:943.930 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: Connected to REDIS...

2025-09-29 Mon 04:58:48:943.958 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-29 Mon 04:58:48:943.970 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: RAC_Connect status: 0 0x108bca0
2025-09-29 Mon 04:58:48:943.976 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: Connected to REDIS...

2025-09-29 Mon 04:58:48:943.985 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-29 Mon 04:58:48:943.994 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: RAC_Connect status: 0 0x10851d0
2025-09-29 Mon 04:58:48:943.999 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: Connected to REDIS...

2025-09-29 Mon 04:58:48:944.008 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-29 Mon 04:58:48:944.017 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: RAC_Connect status: 0 0x108c340
2025-09-29 Mon 04:58:48:944.022 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: Connected to REDIS...

2025-09-29 Mon 04:58:48:944.030 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-29 Mon 04:58:48:944.040 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: RAC_Connect status: 0 0x108c870
2025-09-29 Mon 04:58:48:944.046 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: Connected to REDIS...

2025-09-29 Mon 04:58:48:944.054 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-29 Mon 04:58:48:944.062 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: RAC_Connect status: 0 0x108d1a0
2025-09-29 Mon 04:58:48:944.067 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: Connected to REDIS...

2025-09-29 Mon 04:58:48:944.075 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-29 Mon 04:58:48:944.084 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: RAC_Connect status: 0 0x108dae0
2025-09-29 Mon 04:58:48:944.100 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: Connected to REDIS...

2025-09-29 Mon 04:58:48:944.108 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-29 Mon 04:58:48:944.117 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: RAC_Connect status: 0 0x108e420
2025-09-29 Mon 04:58:48:944.122 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: Connected to REDIS...

2025-09-29 Mon 04:58:48:944.130 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-29 Mon 04:58:48:944.139 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: RAC_Connect status: 0 0x108ffe0
2025-09-29 Mon 04:58:48:944.144 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: Connected to REDIS...

2025-09-29 Mon 04:58:48:944.152 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.48 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-29 Mon 04:58:48:944.160 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: RAC_Connect status: 0 0x108f6a0
2025-09-29 Mon 04:58:48:944.165 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: Connected to REDIS...

2025-09-29 Mon 04:58:48:944.173 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-29 Mon 04:58:48:944.181 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: RAC_Connect status: 0 0x108ed60
2025-09-29 Mon 04:58:48:944.186 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: Connected to REDIS...

2025-09-29 Mon 04:58:48:944.194 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-29 Mon 04:58:48:944.202 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: RAC_Connect status: 0 0x1090920
2025-09-29 Mon 04:58:48:944.207 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: Connected to REDIS...

2025-09-29 Mon 04:58:48:944.214 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.48 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-29 Mon 04:58:48:944.223 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: RAC_Connect status: 0 0x1091260
2025-09-29 Mon 04:58:48:944.228 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: Connected to REDIS...

2025-09-29 Mon 04:58:48:944.235 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.48 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-29 Mon 04:58:48:944.244 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: RAC_Connect status: 0 0x1091ba0
2025-09-29 Mon 04:58:48:944.249 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: Connected to REDIS...

2025-09-29 Mon 04:58:48:944.256 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.48 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-29 Mon 04:58:48:944.267 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: RAC_Connect status: 0 0x10924e0
2025-09-29 Mon 04:58:48:944.272 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: Connected to REDIS...

2025-09-29 Mon 04:58:48:944.280 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.48 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-29 Mon 04:58:48:944.505 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189808715520, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-09-29 Mon 04:58:48:944.541 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189808715520, Pid 1]: SANDESH: Send FAILED: 1759121928943762  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4204-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2025-09-29 Mon 04:58:48:944.550 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189808715520, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-09-29 Mon 04:58:48:944.576 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189808715520, Pid 1]: Processing scm::EvTcpConnectFail in state Connect
2025-09-29 Mon 04:58:48:944.584 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189808715520, Pid 1]: Connect : EvTcpConnectFail
2025-09-29 Mon 04:58:48:944.790 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189808715520, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312
2025-09-29 Mon 04:58:48:944.830 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189808715520, Pid 1]: Idle
2025-09-29 Mon 04:58:48:944.895 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189808715520, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-09-29 Mon 04:58:48:945.009 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189808715520, Pid 1]: SANDESH: Send FAILED: 1759121928944724  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4204-3.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1759121888706833 collector_name =  collector_ip = 10.0.0.48:8086 collector_list= [  [ (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.38:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 39 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 40,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-09-29 Mon 04:58:48:945.026 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189808715520, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-09-29 Mon 04:58:48:945.037 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189808715520, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-09-29 Mon 04:58:48:945.057 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189808715520, Pid 1]: SANDESH: Send FAILED: 1759121928944769  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4204-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2025-09-29 Mon 04:58:48:945.064 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189808715520, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-09-29 Mon 04:58:48:945.073 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189808715520, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle
2025-09-29 Mon 04:58:48:945.117 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189808715520, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-09-29 Mon 04:58:48:946.144 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189808715520, Pid 1]: SANDESH: Send FAILED: 1759121928944886  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4204-3.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1759121888706833 collector_name =  collector_ip = 10.0.0.48:8086 collector_list= [  [ (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.38:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 39 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 41,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-09-29 Mon 04:58:48:946.160 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189808715520, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-09-29 Mon 04:58:48:946.245 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189808715520, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-09-29 Mon 04:58:48:946.315 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189808715520, Pid 1]: SANDESH: Send FAILED: 1759121928946184  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4204-3.:Database:contrail-query-engine:0 sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 14 dequeues = 14 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1759121928944829 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1759121928945115 ] max_sm_queue_count = 5 ]
2025-09-29 Mon 04:58:48:946.324 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189808715520, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-09-29 Mon 04:58:48:946.332 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189808715520, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-09-29 Mon 04:58:48:946.448 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189808715520, Pid 1]: SANDESH: Send FAILED: 1759121928946232  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4204-3.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1759121888706833 collector_name =  collector_ip = 10.0.0.48:8086 collector_list= [  [ (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.38:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 39 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 41,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-09-29 Mon 04:58:48:946.467 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189808715520, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-09-29 Mon 04:58:48:946.580 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-29 Mon 04:58:48:946.593 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-29 Mon 04:58:48:946.608 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-29 Mon 04:58:48:946.621 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-29 Mon 04:58:48:946.635 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-29 Mon 04:58:48:946.645 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-29 Mon 04:58:48:946.658 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-29 Mon 04:58:48:946.667 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-29 Mon 04:58:48:946.680 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-29 Mon 04:58:48:946.697 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-29 Mon 04:58:48:946.726 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-29 Mon 04:58:48:946.736 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-29 Mon 04:58:48:946.749 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-29 Mon 04:58:48:946.758 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-29 Mon 04:58:48:946.770 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-29 Mon 04:58:48:946.779 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-29 Mon 04:58:48:946.792 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-29 Mon 04:58:48:946.801 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-29 Mon 04:58:48:946.858 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-29 Mon 04:58:48:946.886 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189779334912, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-09-29 Mon 04:58:48:946.974 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189779334912, Pid 1]: SANDESH: Send FAILED: 1759121928946835  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4204-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.48:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2025-09-29 Mon 04:58:48:946.989 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189779334912, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-09-29 Mon 04:58:48:947.004 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189779334912, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-09-29 Mon 04:58:48:947.034 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189779334912, Pid 1]: SANDESH: Send FAILED: 1759121928946883  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4204-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.48:6379,  ] ] status = Up description = 10.0.0.38:6379::Down.10.0.0.48:6379::Down. ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-09-29 Mon 04:58:48:947.044 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189779334912, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-09-29 Mon 04:58:48:946.889 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-29 Mon 04:58:48:947.285 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-29 Mon 04:58:48:947.302 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-29 Mon 04:58:48:947.331 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-29 Mon 04:58:48:947.355 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-29 Mon 04:58:48:947.390 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-29 Mon 04:58:48:947.410 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189775136512, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-09-29 Mon 04:58:48:947.605 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-29 Mon 04:58:48:947.627 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189775136512, Pid 1]: SANDESH: Send FAILED: 1759121928947374  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4204-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.48:6379,  ] ] status = Up description = 10.0.0.48:6379::Down. ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-09-29 Mon 04:58:48:947.636 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189775136512, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-09-29 Mon 04:58:48:947.639 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-29 Mon 04:58:48:947.678 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-29 Mon 04:58:48:947.689 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-29 Mon 04:58:48:947.702 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-29 Mon 04:58:48:947.712 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-29 Mon 04:58:48:947.724 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-29 Mon 04:58:48:947.734 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-29 Mon 04:58:48:947.746 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-29 Mon 04:58:48:947.755 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-29 Mon 04:58:48:947.768 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-29 Mon 04:58:48:947.777 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-29 Mon 04:58:48:947.789 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-29 Mon 04:58:48:947.801 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-29 Mon 04:58:48:948.156 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190291207936, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-09-29 Mon 04:58:48:948.189 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190291207936, Pid 1]: SANDESH: Send FAILED: 1759121928947821  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4204-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.48:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-09-29 Mon 04:58:48:948.197 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190291207936, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-09-29 Mon 04:58:48:948.215 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-29 Mon 04:58:48:948.231 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-29 Mon 04:58:48:948.244 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-29 Mon 04:58:48:948.257 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-29 Mon 04:58:48:948.276 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-29 Mon 04:58:48:948.288 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-29 Mon 04:58:49:944.952 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190291207936, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle
2025-09-29 Mon 04:58:49:945.343 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190291207936, Pid 1]: Connect : Start Connect timer 10.0.0.48:8086
2025-09-29 Mon 04:58:49:945.469 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190291207936, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-09-29 Mon 04:58:49:945.512 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190291207936, Pid 1]: SANDESH: Send FAILED: 1759121929945035  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4204-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.48:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.48:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-09-29 Mon 04:58:49:945.537 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190291207936, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-09-29 Mon 04:58:49:945.551 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190291207936, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-09-29 Mon 04:58:49:945.739 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190291207936, Pid 1]: SANDESH: Send FAILED: 1759121929945452  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4204-3.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1759121888706833 collector_name =  collector_ip = 10.0.0.48:8086 collector_list= [  [ (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.38:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 86,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 16,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-09-29 Mon 04:58:49:945.759 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190291207936, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-09-29 Mon 04:58:49:947.671 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.48:42862::10.0.0.48:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280
2025-09-29 Mon 04:58:49:947.692 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: 10.0.0.48:42862::10.0.0.48:8086(-1) OnSessionEvent TCP Connected
2025-09-29 Mon 04:58:49:947.700 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: 10.0.0.48:42862::10.0.0.48:8086(-1):EvTcpConnected
2025-09-29 Mon 04:58:49:948.192 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190287009536, Pid 1]: Processing scm::EvTcpConnected in state Connect
2025-09-29 Mon 04:58:49:948.229 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190287009536, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer
2025-09-29 Mon 04:58:49:948.269 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190287009536, Pid 1]: ClientInit
2025-09-29 Mon 04:58:49:948.295 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190287009536, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-4204-3.:contrail-query-engine:0:Database count 1
2025-09-29 Mon 04:58:49:948.382 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190287009536, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2025-09-29 Mon 04:58:49:948.410 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190287009536, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE
2025-09-29 Mon 04:58:49:948.434 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190287009536, Pid 1]: SANDESH: Send FAILED: 1759121929948261  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4204-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.48:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.48:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-09-29 Mon 04:58:49:948.442 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190287009536, Pid 1]: Received UVE message in wrong state : NodeStatusUVE
2025-09-29 Mon 04:58:49:948.458 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190287009536, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2025-09-29 Mon 04:58:49:948.465 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190287009536, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer
2025-09-29 Mon 04:58:49:948.478 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190287009536, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2025-09-29 Mon 04:58:49:948.485 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190287009536, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace
2025-09-29 Mon 04:58:49:948.589 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190287009536, Pid 1]: SANDESH: Send FAILED: 1759121929948371  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4204-3.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1759121888706833 collector_name =  collector_ip = 10.0.0.48:8086 collector_list= [  [ (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.38:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 87,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-09-29 Mon 04:58:49:948.606 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190287009536, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace
2025-09-29 Mon 04:58:49:950.262 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190287009536, Pid 1]: OnMessage control in state: ClientInit
2025-09-29 Mon 04:58:49:950.306 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190287009536, Pid 1]: Processing scm::EvSandeshMessageRecv in state ClientInit
2025-09-29 Mon 04:58:49:950.319 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190287009536, Pid 1]: ClientInit : EvSandeshMessageRecv
2025-09-29 Mon 04:58:49:950.349 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190287009536, Pid 1]: Received Ctrl Message with size 0
2025-09-29 Mon 04:58:49:950.515 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190287009536, Pid 1]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-4204-3.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1759121888706833 collector_name =  collector_ip = 10.0.0.48:8086 collector_list= [  [ (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.38:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 14 dequeues = 14 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1759121928944829 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1759121928945115 ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 87,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18,  _iter59->first = sent _iter59->second = 0,  ] ] max_sm_queue_count = 5 proxy  seq 10
2025-09-29 Mon 04:58:49:950.545 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190287009536, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1
2025-09-29 Mon 04:58:49:950.571 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190287009536, Pid 1]: SyncUVE Syncing ObjectDatabaseInfo val name = cn-jenkins-deploy-platform-ansible-os-4204-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.48:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.48:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] proxy  seq 11
2025-09-29 Mon 04:58:49:950.586 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190287009536, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1
2025-09-29 Mon 04:58:49:950.593 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190287009536, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 without seqno , total = 0
2025-09-29 Mon 04:58:49:950.600 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190287009536, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0
2025-09-29 Mon 04:58:49:950.627 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190287009536, Pid 1]: Established
2025-09-29 Mon 04:58:59:066.396 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190338045696, Pid 1]: OnMessage control in state: Established
2025-09-29 Mon 04:58:59:066.457 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190338045696, Pid 1]: Processing scm::EvSandeshMessageRecv in state Established
2025-09-29 Mon 04:58:59:066.468 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190338045696, Pid 1]: Established : EvSandeshMessageRecv
2025-09-29 Mon 04:58:59:066.538 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190338045696, Pid 1]: Received Ctrl Message with size 3
2025-09-29 Mon 04:58:59:066.555 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190338045696, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 with seqno 11, total = 0
2025-09-29 Mon 04:58:59:066.567 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190338045696, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 with seqno 13, total = 0
2025-09-29 Mon 04:58:59:066.580 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190338045696, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 with seqno 1, total = 0
2025-09-29 Mon 04:58:59:066.589 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190338045696, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0
2025-09-29 Mon 04:59:18:946.483 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190287009536, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 1 without seqno , total = 0
2025-09-29 Mon 05:00:18:947.727 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190287009536, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 2 without seqno , total = 0
2025-09-29 Mon 05:01:18:531.640 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.48:8091::10.0.0.48:50012 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254
2025-09-29 Mon 05:01:18:948.523 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190291207936, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 3 without seqno , total = 0
2025-09-29 Mon 05:01:41:391.806 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.48:8091::10.0.0.48:46350 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254
2025-09-29 Mon 05:02:18:949.707 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190287009536, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 4 without seqno , total = 0
2025-09-29 Mon 05:03:18:950.883 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140189783533312, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 5 without seqno , total = 0
2025-09-29 Mon 05:03:33:005.323 UTC  cn-jenkins-deploy-platform-ansible-os-4204-3 [Thread 140190485915776, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.48:8091::10.0.0.48:40538 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254