2025-12-29 Mon 05:25:12:499.757 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: http-server-port 8091 2025-12-29 Mon 05:25:12:499.873 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: Max-tasks 16 2025-12-29 Mon 05:25:12:499.885 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: Max-slice 100 2025-12-29 Mon 05:25:12:499.892 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: Collectors 10.0.0.38:8086 2025-12-29 Mon 05:25:12:499.899 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: Collectors 10.0.0.249:8086 2025-12-29 Mon 05:25:12:499.906 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: Collectors 10.0.0.22:8086 2025-12-29 Mon 05:25:12:499.940 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: SANDESH: ROLE : Generator 2025-12-29 Mon 05:25:12:499.946 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: SANDESH: MODULE : contrail-query-engine 2025-12-29 Mon 05:25:12:499.952 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: SANDESH: SOURCE : cn-jenkins-deploy-platform-ansible-os-4935-2. 2025-12-29 Mon 05:25:12:499.957 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: SANDESH: NODE TYPE : Database 2025-12-29 Mon 05:25:12:499.962 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: SANDESH: INSTANCE ID : 0 2025-12-29 Mon 05:25:12:499.967 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: SANDESH: HTTP SERVER PORT : 8091 2025-12-29 Mon 05:25:12:499.972 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: SANDESH: System Log Send Rate Limit: 0 -> 0 2025-12-29 Mon 05:25:12:500.664 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: HTTP Introspect Init 2025-12-29 Mon 05:25:12:501.153 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8091 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-12-29 Mon 05:25:12:501.230 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: Sandesh Http Server Port: 8091 2025-12-29 Mon 05:25:12:501.281 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: SANDESH: NOT Writing http_port 8091TO : /tmp/contrail-query-engine.0.http_port 2025-12-29 Mon 05:25:12:501.293 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: SANDESH: CONNECT TO COLLECTOR: 1 2025-12-29 Mon 05:25:12:501.394 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: Idle 2025-12-29 Mon 05:25:12:501.609 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: SANDESH: No Client: 1766985912501505 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4935-2.:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1766985912501409 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 0, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-29 Mon 05:25:12:501.762 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: SANDESH: Logging: DISABLED -> ENABLED 2025-12-29 Mon 05:25:12:501.780 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ] 2025-12-29 Mon 05:25:12:501.810 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: Cassandra Servers: 10.0.0.38:9042 10.0.0.249:9042 10.0.0.22:9042 2025-12-29 Mon 05:25:12:504.377 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673029797632, Pid 1]: Processing scm::EvStart in state Idle 2025-12-29 Mon 05:25:12:504.477 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673029797632, Pid 1]: Disconnect 2025-12-29 Mon 05:25:12:504.586 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673029797632, Pid 1]: Processing scm::EvCollectorUpdate in state Disconnect 2025-12-29 Mon 05:25:12:507.638 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673029797632, Pid 1]: Connect : Start Connect timer 10.0.0.249:8086 2025-12-29 Mon 05:25:12:507.790 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673029797632, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-12-29 Mon 05:25:12:507.822 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673029797632, Pid 1]: SANDESH: Send FAILED: 1766985912504465 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4935-2. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Idle : EvStart -> Disconnect ], ] ] flag_infos= [ [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ], ] ] ] 2025-12-29 Mon 05:25:12:507.834 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673029797632, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-29 Mon 05:25:12:507.844 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673029797632, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-12-29 Mon 05:25:12:508.058 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673029797632, Pid 1]: SANDESH: Send FAILED: 1766985912504570 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4935-2.:Database:contrail-query-engine:0 client_info= [ status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1766985912501409 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-29 Mon 05:25:12:508.085 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673029797632, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-29 Mon 05:25:12:508.100 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673029797632, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-12-29 Mon 05:25:12:508.192 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673029797632, Pid 1]: SANDESH: Send FAILED: 1766985912504655 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4935-2.:Database:contrail-query-engine:0 client_info= [ status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1766985912501409 collector_name = collector_ip = 10.0.0.249:8086 collector_list= [ [ (*_iter40) = 10.0.0.249:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-29 Mon 05:25:12:508.211 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673029797632, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-29 Mon 05:25:12:508.265 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673029797632, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-12-29 Mon 05:25:12:508.289 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673029797632, Pid 1]: SANDESH: Send FAILED: 1766985912504683 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4935-2. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.249:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], ] ] flag_infos= [ [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ], ] ] ] 2025-12-29 Mon 05:25:12:508.299 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673029797632, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-29 Mon 05:25:12:508.310 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673029797632, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-12-29 Mon 05:25:12:508.398 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673029797632, Pid 1]: SANDESH: Send FAILED: 1766985912507767 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4935-2.:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1766985912501409 collector_name = collector_ip = 10.0.0.249:8086 collector_list= [ [ (*_iter40) = 10.0.0.249:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-29 Mon 05:25:12:508.415 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673029797632, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-29 Mon 05:25:12:511.633 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-12-29 Mon 05:25:12:511.664 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-12-29 Mon 05:25:12:511.727 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 0 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-12-29 Mon 05:25:12:511.979 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673013004032, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-12-29 Mon 05:25:12:512.039 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673013004032, Pid 1]: SANDESH: Send FAILED: 1766985912511701 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4935-2. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.249:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.249:9042, (*_iter6) = 10.0.0.22:9042, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ], ] ] ] 2025-12-29 Mon 05:25:12:512.053 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673013004032, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-29 Mon 05:25:17:514.737 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-12-29 Mon 05:25:17:514.788 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-12-29 Mon 05:25:17:514.832 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 1 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-12-29 Mon 05:25:22:519.727 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-12-29 Mon 05:25:22:519.774 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-12-29 Mon 05:25:22:519.797 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 2 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-12-29 Mon 05:25:27:521.967 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-12-29 Mon 05:25:27:522.024 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-12-29 Mon 05:25:27:522.056 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 3 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-12-29 Mon 05:25:32:524.144 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-12-29 Mon 05:25:32:524.193 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-12-29 Mon 05:25:32:524.214 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 4 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-12-29 Mon 05:25:37:648.845 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004 2025-12-29 Mon 05:25:37:648.896 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-12-29 Mon 05:25:37:648.931 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 5 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-12-29 Mon 05:25:42:691.362 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004 2025-12-29 Mon 05:25:42:699.340 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-12-29 Mon 05:25:42:699.394 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 6 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-12-29 Mon 05:25:47:755.976 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-12-29 Mon 05:25:47:756.071 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 7 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-12-29 Mon 05:25:52:793.949 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: Older table does not exist. will query only the new table src/contrail-analytics/contrail-query-engine/query.cc 1037 2025-12-29 Mon 05:25:57:860.749 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672917030656, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-12-29 Mon 05:25:57:860.830 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672917030656, Pid 1]: SANDESH: Send FAILED: 1766985957860658 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4935-2. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.249:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.249:9042, (*_iter6) = 10.0.0.22:9042, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ], ] ] ] 2025-12-29 Mon 05:25:57:860.852 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672917030656, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-29 Mon 05:25:57:860.772 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: RAC_Connect status: 0 0x26fa5f0 2025-12-29 Mon 05:25:57:861.014 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: Connected to REDIS... 2025-12-29 Mon 05:25:57:861.034 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-12-29 Mon 05:25:57:861.062 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: RAC_Connect status: 0 0x26fad80 2025-12-29 Mon 05:25:57:861.068 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: Connected to REDIS... 2025-12-29 Mon 05:25:57:861.078 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-12-29 Mon 05:25:57:861.089 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: RAC_Connect status: 0 0x26f4250 2025-12-29 Mon 05:25:57:861.094 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: Connected to REDIS... 2025-12-29 Mon 05:25:57:861.102 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-12-29 Mon 05:25:57:861.112 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: RAC_Connect status: 0 0x26fc330 2025-12-29 Mon 05:25:57:861.117 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: Connected to REDIS... 2025-12-29 Mon 05:25:57:861.126 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.249 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-12-29 Mon 05:25:57:861.136 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: RAC_Connect status: 0 0x26fcc70 2025-12-29 Mon 05:25:57:861.142 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: Connected to REDIS... 2025-12-29 Mon 05:25:57:861.158 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.249 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-12-29 Mon 05:25:57:861.168 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: RAC_Connect status: 0 0x26fd5b0 2025-12-29 Mon 05:25:57:861.174 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: Connected to REDIS... 2025-12-29 Mon 05:25:57:861.186 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.249 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-12-29 Mon 05:25:57:861.195 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: RAC_Connect status: 0 0x26fdef0 2025-12-29 Mon 05:25:57:861.200 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: Connected to REDIS... 2025-12-29 Mon 05:25:57:861.209 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.249 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-12-29 Mon 05:25:57:861.222 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: RAC_Connect status: 0 0x26fb310 2025-12-29 Mon 05:25:57:861.229 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: Connected to REDIS... 2025-12-29 Mon 05:25:57:861.241 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-12-29 Mon 05:25:57:861.253 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: RAC_Connect status: 0 0x26fb9f0 2025-12-29 Mon 05:25:57:861.259 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: Connected to REDIS... 2025-12-29 Mon 05:25:57:861.272 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-12-29 Mon 05:25:57:861.285 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: RAC_Connect status: 0 0x26fe830 2025-12-29 Mon 05:25:57:861.293 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: Connected to REDIS... 2025-12-29 Mon 05:25:57:861.304 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.249 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-12-29 Mon 05:25:57:861.313 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: RAC_Connect status: 0 0x26ff170 2025-12-29 Mon 05:25:57:861.318 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: Connected to REDIS... 2025-12-29 Mon 05:25:57:861.326 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.22 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-12-29 Mon 05:25:57:861.335 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: RAC_Connect status: 0 0x26ffab0 2025-12-29 Mon 05:25:57:861.340 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: Connected to REDIS... 2025-12-29 Mon 05:25:57:861.348 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.22 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-12-29 Mon 05:25:57:861.356 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: RAC_Connect status: 0 0x27003f0 2025-12-29 Mon 05:25:57:861.361 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: Connected to REDIS... 2025-12-29 Mon 05:25:57:861.373 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.22 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-12-29 Mon 05:25:57:861.382 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: RAC_Connect status: 0 0x2700d30 2025-12-29 Mon 05:25:57:861.387 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: Connected to REDIS... 2025-12-29 Mon 05:25:57:861.395 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.22 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-12-29 Mon 05:25:57:861.403 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: RAC_Connect status: 0 0x2701670 2025-12-29 Mon 05:25:57:861.408 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: Connected to REDIS... 2025-12-29 Mon 05:25:57:861.415 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.22 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-12-29 Mon 05:25:57:861.444 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: -(-1) OnSessionEvent TCP Connect Failed 2025-12-29 Mon 05:25:57:861.452 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: -(-1):EvTcpConnectFail 2025-12-29 Mon 05:25:57:861.513 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673017202432, Pid 1]: Processing scm::EvTcpConnectFail in state Connect 2025-12-29 Mon 05:25:57:861.544 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673017202432, Pid 1]: Connect : EvTcpConnectFail 2025-12-29 Mon 05:25:57:861.672 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673017202432, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-12-29 Mon 05:25:57:861.716 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673017202432, Pid 1]: Idle 2025-12-29 Mon 05:25:57:861.750 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.249:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-12-29 Mon 05:25:57:861.783 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673017202432, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-12-29 Mon 05:25:57:861.835 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.249:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-12-29 Mon 05:25:57:861.908 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-12-29 Mon 05:25:57:861.933 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673017202432, Pid 1]: SANDESH: Send FAILED: 1766985957861623 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4935-2.:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1766985912501409 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.249:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 39 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 40, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-29 Mon 05:25:57:861.952 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673017202432, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-29 Mon 05:25:57:861.960 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.249:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-12-29 Mon 05:25:57:861.976 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.249:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-12-29 Mon 05:25:57:861.963 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673017202432, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-12-29 Mon 05:25:57:861.991 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.249:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-12-29 Mon 05:25:57:862.019 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.249:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-12-29 Mon 05:25:57:862.020 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673017202432, Pid 1]: SANDESH: Send FAILED: 1766985957861650 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4935-2. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.249:9042, (*_iter6) = 10.0.0.22:9042, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ], ] ] ] 2025-12-29 Mon 05:25:57:862.035 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-12-29 Mon 05:25:57:862.036 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673017202432, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-12-29 Mon 05:25:57:862.048 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-12-29 Mon 05:25:57:862.055 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673017202432, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-12-29 Mon 05:25:57:862.069 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.249:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-12-29 Mon 05:25:57:862.079 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.249:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-12-29 Mon 05:25:57:862.091 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-12-29 Mon 05:25:57:862.100 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-12-29 Mon 05:25:57:862.104 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673017202432, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-12-29 Mon 05:25:57:862.115 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-12-29 Mon 05:25:57:862.128 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-12-29 Mon 05:25:57:862.143 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.249:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-12-29 Mon 05:25:57:862.156 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.249:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-12-29 Mon 05:25:57:862.206 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-12-29 Mon 05:25:57:862.218 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-12-29 Mon 05:25:57:862.223 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673017202432, Pid 1]: SANDESH: Send FAILED: 1766985957861773 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4935-2.:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1766985912501409 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.249:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 40 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 42, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-29 Mon 05:25:57:862.231 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-12-29 Mon 05:25:57:862.242 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673017202432, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-29 Mon 05:25:57:862.255 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-12-29 Mon 05:25:57:862.265 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673017202432, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-12-29 Mon 05:25:57:862.307 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673017202432, Pid 1]: SANDESH: Send FAILED: 1766985957861895 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4935-2. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.249:9042, (*_iter6) = 10.0.0.22:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.249:6379, (*_iter6) = 10.0.0.22:6379, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Collector, Redis-Query:Query connection down ], ] ] ] 2025-12-29 Mon 05:25:57:862.314 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673017202432, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-12-29 Mon 05:25:57:862.325 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-12-29 Mon 05:25:57:862.327 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673017202432, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-12-29 Mon 05:25:57:862.352 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-12-29 Mon 05:25:57:862.357 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673017202432, Pid 1]: SANDESH: Send FAILED: 1766985957862313 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4935-2. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.249:9042, (*_iter6) = 10.0.0.22:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.249:6379, (*_iter6) = 10.0.0.22:6379, ] ] status = Up description = 10.0.0.38:6379::Down.10.0.0.22:6379::Down. ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-29 Mon 05:25:57:862.372 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673017202432, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-12-29 Mon 05:25:57:862.373 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-12-29 Mon 05:25:57:862.414 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-12-29 Mon 05:25:57:862.432 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-12-29 Mon 05:25:57:862.454 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-12-29 Mon 05:25:57:862.470 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-12-29 Mon 05:25:57:862.496 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-12-29 Mon 05:25:57:862.514 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-12-29 Mon 05:25:57:862.534 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.22:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-12-29 Mon 05:25:57:862.546 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.22:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-12-29 Mon 05:25:57:862.592 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.22:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-12-29 Mon 05:25:57:862.603 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.22:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-12-29 Mon 05:25:57:862.616 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.22:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-12-29 Mon 05:25:57:862.546 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673033996032, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-12-29 Mon 05:25:57:862.625 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.22:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-12-29 Mon 05:25:57:862.675 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673033996032, Pid 1]: SANDESH: Send FAILED: 1766985957862406 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4935-2. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.249:9042, (*_iter6) = 10.0.0.22:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.249:6379, (*_iter6) = 10.0.0.22:6379, ] ] status = Up description = 10.0.0.22:6379::Down. ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-29 Mon 05:25:57:862.685 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.22:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-12-29 Mon 05:25:57:862.721 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.22:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-12-29 Mon 05:25:57:862.696 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673033996032, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-12-29 Mon 05:25:57:862.743 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.22:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-12-29 Mon 05:25:57:862.751 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673033996032, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-12-29 Mon 05:25:57:862.760 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.22:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-12-29 Mon 05:25:57:862.796 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-12-29 Mon 05:25:57:862.826 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673033996032, Pid 1]: SANDESH: Send FAILED: 1766985957862407 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4935-2.:Database:contrail-query-engine:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 12 dequeues = 12 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 16 dequeues = 16 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1766985957861714 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1766985957862325 ] max_sm_queue_count = 5 ] 2025-12-29 Mon 05:25:57:862.832 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-12-29 Mon 05:25:57:862.844 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673033996032, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-29 Mon 05:25:57:862.863 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-12-29 Mon 05:25:57:862.876 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673033996032, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-12-29 Mon 05:25:57:862.894 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-12-29 Mon 05:25:57:862.932 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-12-29 Mon 05:25:57:863.084 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673033996032, Pid 1]: SANDESH: Send FAILED: 1766985957862519 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4935-2.:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1766985912501409 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.249:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 67 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 69, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 12, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-29 Mon 05:25:57:863.109 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673033996032, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-29 Mon 05:25:57:863.124 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673033996032, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-12-29 Mon 05:25:57:863.154 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673033996032, Pid 1]: SANDESH: Send FAILED: 1766985957862823 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4935-2. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.249:9042, (*_iter6) = 10.0.0.22:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.249:6379, (*_iter6) = 10.0.0.22:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-29 Mon 05:25:57:863.164 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673033996032, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-12-29 Mon 05:25:58:861.850 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672917030656, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-12-29 Mon 05:25:58:862.130 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672917030656, Pid 1]: Connect : Start Connect timer 10.0.0.22:8086 2025-12-29 Mon 05:25:58:862.289 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672917030656, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-12-29 Mon 05:25:58:862.336 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672917030656, Pid 1]: SANDESH: Send FAILED: 1766985958861943 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4935-2. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.249:9042, (*_iter6) = 10.0.0.22:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.249:6379, (*_iter6) = 10.0.0.22:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-29 Mon 05:25:58:862.364 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672917030656, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-29 Mon 05:25:58:862.378 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672917030656, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-12-29 Mon 05:25:58:862.560 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672917030656, Pid 1]: SANDESH: Send FAILED: 1766985958862267 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4935-2.:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1766985912501409 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.249:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 86, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 16, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-29 Mon 05:25:58:862.588 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672917030656, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-29 Mon 05:25:58:864.336 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.249:49154::10.0.0.22:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280 2025-12-29 Mon 05:25:58:864.367 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: 10.0.0.249:49154::10.0.0.22:8086(-1) OnSessionEvent TCP Connected 2025-12-29 Mon 05:25:58:864.376 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673177667712, Pid 1]: 10.0.0.249:49154::10.0.0.22:8086(-1):EvTcpConnected 2025-12-29 Mon 05:25:58:864.448 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672925427456, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-12-29 Mon 05:25:58:864.477 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672925427456, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-12-29 Mon 05:25:58:864.519 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672925427456, Pid 1]: ClientInit 2025-12-29 Mon 05:25:58:864.541 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672925427456, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-4935-2.:contrail-query-engine:0:Database count 1 2025-12-29 Mon 05:25:58:864.630 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672925427456, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-12-29 Mon 05:25:58:864.640 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672925427456, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-12-29 Mon 05:25:58:864.664 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672925427456, Pid 1]: SANDESH: Send FAILED: 1766985958864511 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4935-2. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.249:9042, (*_iter6) = 10.0.0.22:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.249:6379, (*_iter6) = 10.0.0.22:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-29 Mon 05:25:58:864.672 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672925427456, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-12-29 Mon 05:25:58:864.687 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672925427456, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-12-29 Mon 05:25:58:864.694 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672925427456, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-12-29 Mon 05:25:58:864.706 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672925427456, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-12-29 Mon 05:25:58:864.712 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672925427456, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-12-29 Mon 05:25:58:864.820 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672925427456, Pid 1]: SANDESH: Send FAILED: 1766985958864619 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4935-2.:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1766985912501409 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.249:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 87, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-29 Mon 05:25:58:864.836 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672925427456, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-12-29 Mon 05:25:58:871.341 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672925427456, Pid 1]: OnMessage control in state: ClientInit 2025-12-29 Mon 05:25:58:871.410 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672925427456, Pid 1]: Processing scm::EvSandeshMessageRecv in state ClientInit 2025-12-29 Mon 05:25:58:871.424 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672925427456, Pid 1]: ClientInit : EvSandeshMessageRecv 2025-12-29 Mon 05:25:58:871.457 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672925427456, Pid 1]: Received Ctrl Message with size 0 2025-12-29 Mon 05:25:58:871.675 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672925427456, Pid 1]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-4935-2.:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1766985912501409 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.249:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.38:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 12 dequeues = 12 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 16 dequeues = 16 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1766985957861714 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1766985957862325 ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 87, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18, _iter59->first = sent _iter59->second = 0, ] ] max_sm_queue_count = 5 proxy seq 10 2025-12-29 Mon 05:25:58:871.715 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672925427456, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2025-12-29 Mon 05:25:58:871.755 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672925427456, Pid 1]: SyncUVE Syncing ObjectDatabaseInfo val name = cn-jenkins-deploy-platform-ansible-os-4935-2. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.249:9042, (*_iter6) = 10.0.0.22:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.249:6379, (*_iter6) = 10.0.0.22:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] proxy seq 11 2025-12-29 Mon 05:25:58:871.777 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672925427456, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2025-12-29 Mon 05:25:58:871.788 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672925427456, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 without seqno , total = 0 2025-12-29 Mon 05:25:58:871.800 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672925427456, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0 2025-12-29 Mon 05:25:58:871.847 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672925427456, Pid 1]: Established 2025-12-29 Mon 05:26:08:976.352 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672917030656, Pid 1]: OnMessage control in state: Established 2025-12-29 Mon 05:26:08:976.403 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672917030656, Pid 1]: Processing scm::EvSandeshMessageRecv in state Established 2025-12-29 Mon 05:26:08:976.414 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672917030656, Pid 1]: Established : EvSandeshMessageRecv 2025-12-29 Mon 05:26:08:976.456 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672917030656, Pid 1]: Received Ctrl Message with size 3 2025-12-29 Mon 05:26:08:976.468 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672917030656, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 with seqno 11, total = 0 2025-12-29 Mon 05:26:08:976.479 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672917030656, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 with seqno 13, total = 0 2025-12-29 Mon 05:26:08:976.490 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672917030656, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 with seqno 1, total = 0 2025-12-29 Mon 05:26:08:976.498 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672917030656, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0 2025-12-29 Mon 05:26:27:862.758 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672925427456, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 1 without seqno , total = 0 2025-12-29 Mon 05:27:27:863.305 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672929625856, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 2 without seqno , total = 0 2025-12-29 Mon 05:28:27:864.523 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672896042752, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 3 without seqno , total = 0 2025-12-29 Mon 05:29:27:865.091 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673021400832, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 4 without seqno , total = 0 2025-12-29 Mon 05:30:27:865.615 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673004607232, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 5 without seqno , total = 0 2025-12-29 Mon 05:31:27:866.294 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672917030656, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 6 without seqno , total = 0 2025-12-29 Mon 05:32:27:866.835 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672917030656, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 7 without seqno , total = 0 2025-12-29 Mon 05:33:27:867.424 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672912832256, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 8 without seqno , total = 0 2025-12-29 Mon 05:34:27:867.940 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672900241152, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 9 without seqno , total = 0 2025-12-29 Mon 05:35:27:868.897 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672912832256, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 10 without seqno , total = 0 2025-12-29 Mon 05:36:27:869.415 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672929625856, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 11 without seqno , total = 0 2025-12-29 Mon 05:37:27:869.986 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673013004032, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 12 without seqno , total = 0 2025-12-29 Mon 05:38:27:870.500 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672929625856, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 13 without seqno , total = 0 2025-12-29 Mon 05:39:27:871.019 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673017202432, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 14 without seqno , total = 0 2025-12-29 Mon 05:40:27:871.776 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672912832256, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 15 without seqno , total = 0 2025-12-29 Mon 05:41:27:872.268 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672891844352, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 16 without seqno , total = 0 2025-12-29 Mon 05:42:27:872.871 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672921229056, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 17 without seqno , total = 0 2025-12-29 Mon 05:43:27:873.447 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673004607232, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 18 without seqno , total = 0 2025-12-29 Mon 05:44:27:874.063 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672917030656, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 19 without seqno , total = 0 2025-12-29 Mon 05:45:27:874.626 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673021400832, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 20 without seqno , total = 0 2025-12-29 Mon 05:46:27:875.215 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673017202432, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 21 without seqno , total = 0 2025-12-29 Mon 05:47:27:875.703 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672917030656, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 22 without seqno , total = 0 2025-12-29 Mon 05:48:27:876.299 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672921229056, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 23 without seqno , total = 0 2025-12-29 Mon 05:49:27:876.844 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672917030656, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 24 without seqno , total = 0 2025-12-29 Mon 05:50:27:877.440 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673008805632, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 25 without seqno , total = 0 2025-12-29 Mon 05:51:27:878.091 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672929625856, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 26 without seqno , total = 0 2025-12-29 Mon 05:52:27:878.632 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140673021400832, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 27 without seqno , total = 0 2025-12-29 Mon 05:53:27:879.137 UTC cn-jenkins-deploy-platform-ansible-os-4935-2 [Thread 140672900241152, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 28 without seqno , total = 0