2025-09-08 Mon 05:20:21:158.324 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: http-server-port 8091
2025-09-08 Mon 05:20:21:158.417 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: Max-tasks 16
2025-09-08 Mon 05:20:21:158.426 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: Max-slice 100
2025-09-08 Mon 05:20:21:158.432 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: Collectors  10.0.0.254:8086
2025-09-08 Mon 05:20:21:158.437 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: Collectors  10.0.0.38:8086
2025-09-08 Mon 05:20:21:158.441 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: Collectors  10.0.0.50:8086
2025-09-08 Mon 05:20:21:158.459 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: SANDESH: ROLE             : Generator
2025-09-08 Mon 05:20:21:158.465 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: SANDESH: MODULE           : contrail-query-engine
2025-09-08 Mon 05:20:21:158.470 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: SANDESH: SOURCE           : cn-jenkins-deploy-platform-ansible-os-4042-1.
2025-09-08 Mon 05:20:21:158.476 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: SANDESH: NODE TYPE        : Database
2025-09-08 Mon 05:20:21:158.481 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: SANDESH: INSTANCE ID      : 0
2025-09-08 Mon 05:20:21:158.486 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: SANDESH: HTTP SERVER PORT : 8091
2025-09-08 Mon 05:20:21:158.491 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: SANDESH: System Log Send Rate Limit: 0 -> 0
2025-09-08 Mon 05:20:21:159.137 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: HTTP Introspect Init
2025-09-08 Mon 05:20:21:159.245 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8091  Initialization complete src/contrail-common/io/tcp_server.cc 137
2025-09-08 Mon 05:20:21:159.299 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: Sandesh Http Server Port: 8091
2025-09-08 Mon 05:20:21:159.335 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: SANDESH: NOT Writing http_port 8091TO : /tmp/contrail-query-engine.0.http_port
2025-09-08 Mon 05:20:21:159.343 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: SANDESH: CONNECT TO COLLECTOR: 1
2025-09-08 Mon 05:20:21:159.414 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: Idle
2025-09-08 Mon 05:20:21:159.586 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: SANDESH: No Client: 1757308821159493  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4042-1.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1757308821159424 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 0,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-09-08 Mon 05:20:21:159.712 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: SANDESH: Logging: DISABLED -> ENABLED
2025-09-08 Mon 05:20:21:159.732 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ]
2025-09-08 Mon 05:20:21:159.744 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: Cassandra Servers: 10.0.0.254:9042 10.0.0.38:9042 10.0.0.50:9042 
2025-09-08 Mon 05:20:21:167.307 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050241898240, Pid 1]: Processing scm::EvStart in state Idle
2025-09-08 Mon 05:20:21:167.517 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050241898240, Pid 1]: Disconnect
2025-09-08 Mon 05:20:21:167.803 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050241898240, Pid 1]: Processing scm::EvCollectorUpdate in state Disconnect
2025-09-08 Mon 05:20:21:168.085 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050241898240, Pid 1]: Connect : Start Connect timer 10.0.0.254:8086
2025-09-08 Mon 05:20:21:168.168 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050241898240, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-09-08 Mon 05:20:21:168.190 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050241898240, Pid 1]: SANDESH: Send FAILED: 1757308821167507  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4042-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Idle : EvStart -> Disconnect ],  ] ] flag_infos= [  [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ],  ] ] ]
2025-09-08 Mon 05:20:21:168.199 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050241898240, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-09-08 Mon 05:20:21:168.208 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050241898240, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-09-08 Mon 05:20:21:168.287 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050241898240, Pid 1]: SANDESH: Send FAILED: 1757308821167733  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4042-1.:Database:contrail-query-engine:0 client_info= [  status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1757308821159424 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-09-08 Mon 05:20:21:168.304 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050241898240, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-09-08 Mon 05:20:21:168.314 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050241898240, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-09-08 Mon 05:20:21:168.382 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050241898240, Pid 1]: SANDESH: Send FAILED: 1757308821167883  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4042-1.:Database:contrail-query-engine:0 client_info= [  status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1757308821159424 collector_name =  collector_ip = 10.0.0.254:8086 collector_list= [  [ (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.50:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-09-08 Mon 05:20:21:168.395 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050241898240, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-09-08 Mon 05:20:21:168.404 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050241898240, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-09-08 Mon 05:20:21:168.419 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050241898240, Pid 1]: SANDESH: Send FAILED: 1757308821167907  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4042-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  ] ] flag_infos= [  [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ],  ] ] ]
2025-09-08 Mon 05:20:21:168.425 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050241898240, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-09-08 Mon 05:20:21:168.432 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050241898240, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-09-08 Mon 05:20:21:168.495 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050241898240, Pid 1]: SANDESH: Send FAILED: 1757308821168154  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4042-1.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1757308821159424 collector_name =  collector_ip = 10.0.0.254:8086 collector_list= [  [ (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.50:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-09-08 Mon 05:20:21:168.507 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050241898240, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-09-08 Mon 05:20:21:168.948 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-09-08 Mon 05:20:21:168.966 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-09-08 Mon 05:20:21:169.013 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 0 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-09-08 Mon 05:20:21:169.041 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050241898240, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-09-08 Mon 05:20:21:169.063 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050241898240, Pid 1]: SANDESH: Send FAILED: 1757308821168994  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4042-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2025-09-08 Mon 05:20:21:169.071 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050241898240, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-09-08 Mon 05:20:26:175.435 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-09-08 Mon 05:20:26:175.600 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-09-08 Mon 05:20:26:175.641 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 1 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-09-08 Mon 05:20:31:177.439 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-09-08 Mon 05:20:31:177.482 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-09-08 Mon 05:20:31:177.512 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 2 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-09-08 Mon 05:20:36:182.614 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-09-08 Mon 05:20:36:182.652 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-09-08 Mon 05:20:36:182.676 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 3 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-09-08 Mon 05:20:41:262.988 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004
2025-09-08 Mon 05:20:41:263.028 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-09-08 Mon 05:20:41:263.051 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 4 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-09-08 Mon 05:20:46:286.311 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004
2025-09-08 Mon 05:20:46:286.384 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-09-08 Mon 05:20:46:286.410 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 5 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-09-08 Mon 05:20:51:337.389 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004
2025-09-08 Mon 05:20:51:338.084 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-09-08 Mon 05:20:51:338.110 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 6 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-09-08 Mon 05:20:56:361.763 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-09-08 Mon 05:20:56:361.823 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 7 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-09-08 Mon 05:21:01:399.037 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: Older table does not exist. will query only the new table src/contrail-analytics/contrail-query-engine/query.cc 1037
2025-09-08 Mon 05:21:06:405.298 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-09-08 Mon 05:21:06:405.326 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: RAC_Connect status: 0 0x2b9f830
2025-09-08 Mon 05:21:06:405.379 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: Connected to REDIS...

2025-09-08 Mon 05:21:06:405.400 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-08 Mon 05:21:06:405.412 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: RAC_Connect status: 0 0x2b9bda0
2025-09-08 Mon 05:21:06:405.418 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: Connected to REDIS...

2025-09-08 Mon 05:21:06:405.427 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-08 Mon 05:21:06:405.436 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: RAC_Connect status: 0 0x2ba0400
2025-09-08 Mon 05:21:06:405.441 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: Connected to REDIS...

2025-09-08 Mon 05:21:06:405.449 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-08 Mon 05:21:06:405.458 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: RAC_Connect status: 0 0x2ba0b50
2025-09-08 Mon 05:21:06:405.463 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: Connected to REDIS...

2025-09-08 Mon 05:21:06:405.471 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-08 Mon 05:21:06:405.480 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: RAC_Connect status: 0 0x2ba1470
2025-09-08 Mon 05:21:06:405.485 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: Connected to REDIS...

2025-09-08 Mon 05:21:06:405.493 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-08 Mon 05:21:06:405.501 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: RAC_Connect status: 0 0x2ba1d70
2025-09-08 Mon 05:21:06:405.506 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: Connected to REDIS...

2025-09-08 Mon 05:21:06:405.514 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-08 Mon 05:21:06:405.522 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: RAC_Connect status: 0 0x2ba2ff0
2025-09-08 Mon 05:21:06:405.527 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: Connected to REDIS...

2025-09-08 Mon 05:21:06:405.544 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-08 Mon 05:21:06:405.565 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: RAC_Connect status: 0 0x2ba3930
2025-09-08 Mon 05:21:06:405.571 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: Connected to REDIS...

2025-09-08 Mon 05:21:06:405.579 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-08 Mon 05:21:06:405.587 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: RAC_Connect status: 0 0x2ba26b0
2025-09-08 Mon 05:21:06:405.592 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: Connected to REDIS...

2025-09-08 Mon 05:21:06:405.599 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-08 Mon 05:21:06:405.607 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: RAC_Connect status: 0 0x2ba4270
2025-09-08 Mon 05:21:06:405.612 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: Connected to REDIS...

2025-09-08 Mon 05:21:06:405.619 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-08 Mon 05:21:06:405.628 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: RAC_Connect status: 0 0x2ba54f0
2025-09-08 Mon 05:21:06:405.633 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: Connected to REDIS...

2025-09-08 Mon 05:21:06:405.640 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-08 Mon 05:21:06:405.648 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: RAC_Connect status: 0 0x2ba4bb0
2025-09-08 Mon 05:21:06:405.653 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: Connected to REDIS...

2025-09-08 Mon 05:21:06:405.660 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-08 Mon 05:21:06:405.668 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: RAC_Connect status: 0 0x2ba5e30
2025-09-08 Mon 05:21:06:405.673 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: Connected to REDIS...

2025-09-08 Mon 05:21:06:405.680 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-08 Mon 05:21:06:405.688 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: RAC_Connect status: 0 0x2ba6770
2025-09-08 Mon 05:21:06:405.693 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: Connected to REDIS...

2025-09-08 Mon 05:21:06:405.700 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-08 Mon 05:21:06:405.709 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: RAC_Connect status: 0 0x2ba70b0
2025-09-08 Mon 05:21:06:405.717 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: Connected to REDIS...

2025-09-08 Mon 05:21:06:405.725 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-09-08 Mon 05:21:06:405.750 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: -(-1) OnSessionEvent TCP Connect Failed
2025-09-08 Mon 05:21:06:405.757 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: -(-1):EvTcpConnectFail
2025-09-08 Mon 05:21:06:405.371 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: SANDESH: Send FAILED: 1757308866405209  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4042-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2025-09-08 Mon 05:21:06:406.253 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-09-08 Mon 05:21:06:406.288 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: Processing scm::EvTcpConnectFail in state Connect
2025-09-08 Mon 05:21:06:406.296 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: Connect : EvTcpConnectFail
2025-09-08 Mon 05:21:06:406.375 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-08 Mon 05:21:06:406.397 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-08 Mon 05:21:06:406.414 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-08 Mon 05:21:06:406.424 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-08 Mon 05:21:06:406.438 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-08 Mon 05:21:06:406.445 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312
2025-09-08 Mon 05:21:06:406.447 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-08 Mon 05:21:06:406.490 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: Idle
2025-09-08 Mon 05:21:06:406.492 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-08 Mon 05:21:06:406.538 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-08 Mon 05:21:06:406.571 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-08 Mon 05:21:06:406.602 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-08 Mon 05:21:06:406.619 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-08 Mon 05:21:06:406.629 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-09-08 Mon 05:21:06:406.631 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-08 Mon 05:21:06:406.686 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-08 Mon 05:21:06:406.707 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-08 Mon 05:21:06:406.744 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-08 Mon 05:21:06:406.761 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-08 Mon 05:21:06:406.763 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: SANDESH: Send FAILED: 1757308866406395  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4042-1.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1757308821159424 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.50:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 39 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 40,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-09-08 Mon 05:21:06:406.800 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-09-08 Mon 05:21:06:406.786 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-08 Mon 05:21:06:406.835 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-08 Mon 05:21:06:406.865 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-08 Mon 05:21:06:406.879 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-08 Mon 05:21:06:406.996 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-08 Mon 05:21:06:407.058 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-08 Mon 05:21:06:407.094 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-08 Mon 05:21:06:407.122 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-08 Mon 05:21:06:407.148 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-08 Mon 05:21:06:407.178 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-08 Mon 05:21:06:407.202 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-08 Mon 05:21:06:407.218 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-08 Mon 05:21:06:407.233 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-08 Mon 05:21:06:407.247 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-08 Mon 05:21:06:407.290 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-08 Mon 05:21:06:407.301 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-08 Mon 05:21:06:407.315 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-08 Mon 05:21:06:407.324 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-08 Mon 05:21:06:407.337 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-08 Mon 05:21:06:407.345 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-08 Mon 05:21:06:407.358 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-08 Mon 05:21:06:407.366 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-08 Mon 05:21:06:407.379 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-09-08 Mon 05:21:06:407.388 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-09-08 Mon 05:21:06:407.478 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-08 Mon 05:21:06:407.506 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-08 Mon 05:21:06:407.530 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-08 Mon 05:21:06:407.543 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-08 Mon 05:21:06:407.565 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-09-08 Mon 05:21:06:406.815 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-09-08 Mon 05:21:06:410.987 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: SANDESH: Send FAILED: 1757308866406421  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4042-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2025-09-08 Mon 05:21:06:410.997 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-09-08 Mon 05:21:06:411.009 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle
2025-09-08 Mon 05:21:06:411.051 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-09-08 Mon 05:21:06:411.164 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: SANDESH: Send FAILED: 1757308866406606  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4042-1.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1757308821159424 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.50:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 48 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 50,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-09-08 Mon 05:21:06:411.182 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-09-08 Mon 05:21:06:411.193 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-09-08 Mon 05:21:06:411.213 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: SANDESH: Send FAILED: 1757308866406975  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4042-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2025-09-08 Mon 05:21:06:411.223 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-09-08 Mon 05:21:06:411.232 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-09-08 Mon 05:21:06:411.249 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: SANDESH: Send FAILED: 1757308866407048  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4042-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  ] ] status = Up description = 10.0.0.254:6379::Down.10.0.0.50:6379::Down. ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-09-08 Mon 05:21:06:411.256 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-09-08 Mon 05:21:06:411.264 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-09-08 Mon 05:21:06:411.281 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: SANDESH: Send FAILED: 1757308866407172  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4042-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  ] ] status = Up description = 10.0.0.50:6379::Down. ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-09-08 Mon 05:21:06:411.287 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-09-08 Mon 05:21:06:411.294 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-09-08 Mon 05:21:06:411.311 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: SANDESH: Send FAILED: 1757308866407499  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4042-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-09-08 Mon 05:21:06:411.320 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-09-08 Mon 05:21:06:411.426 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-09-08 Mon 05:21:06:411.468 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: SANDESH: Send FAILED: 1757308866411352  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4042-1.:Database:contrail-query-engine:0 sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 14 dequeues = 14 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 18 dequeues = 18 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1757308866406489 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1757308866411293 ] max_sm_queue_count = 6 ]
2025-09-08 Mon 05:21:06:411.475 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-09-08 Mon 05:21:06:411.483 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-09-08 Mon 05:21:06:411.589 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: SANDESH: Send FAILED: 1757308866411412  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4042-1.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1757308821159424 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.50:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 86,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 14,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-09-08 Mon 05:21:06:411.606 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050129983232, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-09-08 Mon 05:21:07:406.793 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050155169536, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle
2025-09-08 Mon 05:21:07:414.900 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050155169536, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086
2025-09-08 Mon 05:21:07:415.060 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050155169536, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-09-08 Mon 05:21:07:415.092 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050155169536, Pid 1]: SANDESH: Send FAILED: 1757308867414747  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4042-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-09-08 Mon 05:21:07:415.113 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050155169536, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-09-08 Mon 05:21:07:415.123 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050155169536, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-09-08 Mon 05:21:07:415.235 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050155169536, Pid 1]: SANDESH: Send FAILED: 1757308867415045  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4042-1.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1757308821159424 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.50:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 86,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 16,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-09-08 Mon 05:21:07:415.250 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050155169536, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-09-08 Mon 05:21:07:417.246 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.254:40918::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280
2025-09-08 Mon 05:21:07:417.269 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: 10.0.0.254:40918::10.0.0.38:8086(-1) OnSessionEvent TCP Connected
2025-09-08 Mon 05:21:07:417.277 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: 10.0.0.254:40918::10.0.0.38:8086(-1):EvTcpConnected
2025-09-08 Mon 05:21:07:417.750 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050121586432, Pid 1]: Processing scm::EvTcpConnected in state Connect
2025-09-08 Mon 05:21:07:417.771 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050121586432, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer
2025-09-08 Mon 05:21:07:417.804 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050121586432, Pid 1]: ClientInit
2025-09-08 Mon 05:21:07:417.820 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050121586432, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-4042-1.:contrail-query-engine:0:Database count 1
2025-09-08 Mon 05:21:07:417.905 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050121586432, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2025-09-08 Mon 05:21:07:417.915 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050121586432, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE
2025-09-08 Mon 05:21:07:417.938 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050121586432, Pid 1]: SANDESH: Send FAILED: 1757308867417796  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4042-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-09-08 Mon 05:21:07:417.945 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050121586432, Pid 1]: Received UVE message in wrong state : NodeStatusUVE
2025-09-08 Mon 05:21:07:417.960 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050121586432, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2025-09-08 Mon 05:21:07:417.967 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050121586432, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer
2025-09-08 Mon 05:21:07:417.978 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050121586432, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2025-09-08 Mon 05:21:07:417.985 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050121586432, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace
2025-09-08 Mon 05:21:07:418.090 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050121586432, Pid 1]: SANDESH: Send FAILED: 1757308867417894  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4042-1.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1757308821159424 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.50:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 87,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-09-08 Mon 05:21:07:418.106 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050121586432, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace
2025-09-08 Mon 05:21:07:472.829 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050246096640, Pid 1]: OnMessage control in state: ClientInit
2025-09-08 Mon 05:21:07:473.032 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050237699840, Pid 1]: Processing scm::EvSandeshMessageRecv in state ClientInit
2025-09-08 Mon 05:21:07:473.068 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050237699840, Pid 1]: ClientInit : EvSandeshMessageRecv
2025-09-08 Mon 05:21:07:473.099 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050237699840, Pid 1]: Received Ctrl Message with size 0
2025-09-08 Mon 05:21:07:473.258 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050237699840, Pid 1]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-4042-1.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1757308821159424 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.50:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 14 dequeues = 14 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 18 dequeues = 18 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1757308866406489 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1757308866411293 ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 87,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18,  _iter59->first = sent _iter59->second = 0,  ] ] max_sm_queue_count = 6 proxy  seq 10
2025-09-08 Mon 05:21:07:473.289 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050237699840, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1
2025-09-08 Mon 05:21:07:473.316 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050237699840, Pid 1]: SyncUVE Syncing ObjectDatabaseInfo val name = cn-jenkins-deploy-platform-ansible-os-4042-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] proxy  seq 11
2025-09-08 Mon 05:21:07:473.333 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050237699840, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1
2025-09-08 Mon 05:21:07:473.340 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050237699840, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 without seqno , total = 0
2025-09-08 Mon 05:21:07:473.348 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050237699840, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0
2025-09-08 Mon 05:21:07:473.381 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050237699840, Pid 1]: Established
2025-09-08 Mon 05:21:13:418.579 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050237699840, Pid 1]: OnMessage control in state: Established
2025-09-08 Mon 05:21:13:418.641 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050237699840, Pid 1]: Processing scm::EvSandeshMessageRecv in state Established
2025-09-08 Mon 05:21:13:418.651 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050237699840, Pid 1]: Established : EvSandeshMessageRecv
2025-09-08 Mon 05:21:13:418.695 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050237699840, Pid 1]: Received Ctrl Message with size 3
2025-09-08 Mon 05:21:13:418.708 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050237699840, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 with seqno 11, total = 0
2025-09-08 Mon 05:21:13:418.719 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050237699840, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 with seqno 13, total = 0
2025-09-08 Mon 05:21:13:418.730 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050237699840, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 with seqno 1, total = 0
2025-09-08 Mon 05:21:13:418.738 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050237699840, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0
2025-09-08 Mon 05:21:36:411.705 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050233501440, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 1 without seqno , total = 0
2025-09-08 Mon 05:22:36:412.776 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050159367936, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 2 without seqno , total = 0
2025-09-08 Mon 05:23:16:541.443 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.254:8091::10.0.0.254:56304 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254
2025-09-08 Mon 05:23:36:413.284 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050125784832, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 3 without seqno , total = 0
2025-09-08 Mon 05:23:53:678.647 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.254:8091::10.0.0.254:60874 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254
2025-09-08 Mon 05:24:36:413.773 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050233501440, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 4 without seqno , total = 0
2025-09-08 Mon 05:24:55:309.327 UTC  cn-jenkins-deploy-platform-ansible-os-4042-1 [Thread 140050389768320, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.254:8091::10.0.0.254:43886 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254