2025-06-05 Thu 00:44:22:919.895 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: http-server-port 8091 2025-06-05 Thu 00:44:22:920.044 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: Max-tasks 16 2025-06-05 Thu 00:44:22:920.059 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: Max-slice 100 2025-06-05 Thu 00:44:22:920.070 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: Collectors 10.0.0.249:8086 2025-06-05 Thu 00:44:22:920.080 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: Collectors 10.0.0.27:8086 2025-06-05 Thu 00:44:22:920.088 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: Collectors 10.0.0.131:8086 2025-06-05 Thu 00:44:22:920.120 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: SANDESH: ROLE : Generator 2025-06-05 Thu 00:44:22:920.131 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: SANDESH: MODULE : contrail-query-engine 2025-06-05 Thu 00:44:22:920.140 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: SANDESH: SOURCE : cn-jenkins-deploy-platform-ansible-os-3401-3. 2025-06-05 Thu 00:44:22:920.148 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: SANDESH: NODE TYPE : Database 2025-06-05 Thu 00:44:22:920.157 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: SANDESH: INSTANCE ID : 0 2025-06-05 Thu 00:44:22:920.166 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: SANDESH: HTTP SERVER PORT : 8091 2025-06-05 Thu 00:44:22:920.175 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: SANDESH: System Log Send Rate Limit: 0 -> 0 2025-06-05 Thu 00:44:22:921.078 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: HTTP Introspect Init 2025-06-05 Thu 00:44:22:921.239 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8091 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-06-05 Thu 00:44:22:921.332 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: Sandesh Http Server Port: 8091 2025-06-05 Thu 00:44:22:921.397 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: SANDESH: NOT Writing http_port 8091TO : /tmp/contrail-query-engine.0.http_port 2025-06-05 Thu 00:44:22:921.411 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: SANDESH: CONNECT TO COLLECTOR: 1 2025-06-05 Thu 00:44:22:921.588 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: Idle 2025-06-05 Thu 00:44:22:921.843 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: SANDESH: No Client: 1749084262921718 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1749084262921606 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 0, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-06-05 Thu 00:44:22:922.058 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: SANDESH: Logging: DISABLED -> ENABLED 2025-06-05 Thu 00:44:22:922.085 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ] 2025-06-05 Thu 00:44:22:922.106 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: Cassandra Servers: 10.0.0.249:9042 10.0.0.27:9042 10.0.0.131:9042 2025-06-05 Thu 00:44:22:922.310 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498863077120, Pid 1]: Processing scm::EvStart in state Idle 2025-06-05 Thu 00:44:22:922.412 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498863077120, Pid 1]: Disconnect 2025-06-05 Thu 00:44:22:922.533 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498863077120, Pid 1]: Processing scm::EvCollectorUpdate in state Disconnect 2025-06-05 Thu 00:44:22:922.869 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498863077120, Pid 1]: Connect : Start Connect timer 10.0.0.27:8086 2025-06-05 Thu 00:44:22:922.958 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498863077120, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-06-05 Thu 00:44:22:922.985 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498863077120, Pid 1]: SANDESH: Send FAILED: 1749084262922401 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Idle : EvStart -> Disconnect ], ] ] flag_infos= [ [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ], ] ] ] 2025-06-05 Thu 00:44:22:922.996 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498863077120, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-06-05 Thu 00:44:22:923.006 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498863077120, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-06-05 Thu 00:44:22:923.101 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498863077120, Pid 1]: SANDESH: Send FAILED: 1749084262922517 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Database:contrail-query-engine:0 client_info= [ status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1749084262921606 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-06-05 Thu 00:44:22:923.122 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498863077120, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-06-05 Thu 00:44:22:923.133 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498863077120, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-06-05 Thu 00:44:22:923.214 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498863077120, Pid 1]: SANDESH: Send FAILED: 1749084262922624 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Database:contrail-query-engine:0 client_info= [ status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1749084262921606 collector_name = collector_ip = 10.0.0.27:8086 collector_list= [ [ (*_iter40) = 10.0.0.27:8086, (*_iter40) = 10.0.0.249:8086, (*_iter40) = 10.0.0.131:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-06-05 Thu 00:44:22:923.228 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498863077120, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-06-05 Thu 00:44:22:923.238 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498863077120, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-06-05 Thu 00:44:22:923.255 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498863077120, Pid 1]: SANDESH: Send FAILED: 1749084262922662 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.27:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], ] ] flag_infos= [ [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ], ] ] ] 2025-06-05 Thu 00:44:22:923.263 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498863077120, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-06-05 Thu 00:44:22:923.271 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498863077120, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-06-05 Thu 00:44:22:923.342 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498863077120, Pid 1]: SANDESH: Send FAILED: 1749084262922944 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1749084262921606 collector_name = collector_ip = 10.0.0.27:8086 collector_list= [ [ (*_iter40) = 10.0.0.27:8086, (*_iter40) = 10.0.0.249:8086, (*_iter40) = 10.0.0.131:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-06-05 Thu 00:44:22:923.356 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498863077120, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-06-05 Thu 00:44:22:937.627 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-06-05 Thu 00:44:22:937.678 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-06-05 Thu 00:44:22:937.833 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498756933376, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-06-05 Thu 00:44:22:937.871 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498756933376, Pid 1]: SANDESH: Send FAILED: 1749084262937726 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.27:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.249:9042, (*_iter6) = 10.0.0.27:9042, (*_iter6) = 10.0.0.131:9042, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ], ] ] ] 2025-06-05 Thu 00:44:22:937.882 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498756933376, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-06-05 Thu 00:44:22:938.062 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 0 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-06-05 Thu 00:44:27:941.629 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-06-05 Thu 00:44:27:941.681 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-06-05 Thu 00:44:27:941.724 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 1 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-06-05 Thu 00:44:32:943.850 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-06-05 Thu 00:44:32:943.922 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-06-05 Thu 00:44:32:943.953 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 2 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-06-05 Thu 00:44:37:946.241 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-06-05 Thu 00:44:37:946.306 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-06-05 Thu 00:44:37:946.332 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 3 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-06-05 Thu 00:44:43:008.353 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004 2025-06-05 Thu 00:44:43:008.416 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-06-05 Thu 00:44:43:008.452 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 4 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-06-05 Thu 00:44:48:032.356 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004 2025-06-05 Thu 00:44:48:032.420 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-06-05 Thu 00:44:48:032.445 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 5 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-06-05 Thu 00:44:53:081.658 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-06-05 Thu 00:44:53:081.723 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 6 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-06-05 Thu 00:44:58:103.699 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: Older table does not exist. will query only the new table src/contrail-analytics/contrail-query-engine/query.cc 1037 2025-06-05 Thu 00:45:03:117.748 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: -(-1) OnSessionEvent TCP Connect Failed 2025-06-05 Thu 00:45:03:117.804 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: -(-1):EvTcpConnectFail 2025-06-05 Thu 00:45:03:117.828 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: RAC_Connect status: 0 0x14335f0 2025-06-05 Thu 00:45:03:117.839 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: Connected to REDIS... 2025-06-05 Thu 00:45:03:117.860 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.249 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-06-05 Thu 00:45:03:117.879 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: RAC_Connect status: 0 0x142d1d0 2025-06-05 Thu 00:45:03:117.887 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: Connected to REDIS... 2025-06-05 Thu 00:45:03:117.897 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.249 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-06-05 Thu 00:45:03:117.908 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: RAC_Connect status: 0 0x1433ca0 2025-06-05 Thu 00:45:03:117.914 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: Connected to REDIS... 2025-06-05 Thu 00:45:03:117.923 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.249 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-06-05 Thu 00:45:03:117.933 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: RAC_Connect status: 0 0x1434340 2025-06-05 Thu 00:45:03:117.939 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: Connected to REDIS... 2025-06-05 Thu 00:45:03:117.949 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.249 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-06-05 Thu 00:45:03:117.959 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: RAC_Connect status: 0 0x1434870 2025-06-05 Thu 00:45:03:117.965 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: Connected to REDIS... 2025-06-05 Thu 00:45:03:117.983 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.249 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-06-05 Thu 00:45:03:117.994 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: RAC_Connect status: 0 0x14351a0 2025-06-05 Thu 00:45:03:118.000 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: Connected to REDIS... 2025-06-05 Thu 00:45:03:118.009 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.27 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-06-05 Thu 00:45:03:118.020 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: RAC_Connect status: 0 0x1435ae0 2025-06-05 Thu 00:45:03:118.027 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: Connected to REDIS... 2025-06-05 Thu 00:45:03:118.036 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.27 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-06-05 Thu 00:45:03:118.047 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: RAC_Connect status: 0 0x1436420 2025-06-05 Thu 00:45:03:118.053 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: Connected to REDIS... 2025-06-05 Thu 00:45:03:118.066 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.27 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-06-05 Thu 00:45:03:118.077 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: RAC_Connect status: 0 0x1436d60 2025-06-05 Thu 00:45:03:118.084 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: Connected to REDIS... 2025-06-05 Thu 00:45:03:118.093 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.27 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-06-05 Thu 00:45:03:118.104 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: RAC_Connect status: 0 0x14376a0 2025-06-05 Thu 00:45:03:118.109 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: Connected to REDIS... 2025-06-05 Thu 00:45:03:118.118 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.27 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-06-05 Thu 00:45:03:118.129 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: RAC_Connect status: 0 0x1437fe0 2025-06-05 Thu 00:45:03:118.135 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: Connected to REDIS... 2025-06-05 Thu 00:45:03:118.144 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.131 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-06-05 Thu 00:45:03:118.154 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: RAC_Connect status: 0 0x1438920 2025-06-05 Thu 00:45:03:118.160 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: Connected to REDIS... 2025-06-05 Thu 00:45:03:118.169 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.131 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-06-05 Thu 00:45:03:118.178 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: RAC_Connect status: 0 0x1439260 2025-06-05 Thu 00:45:03:118.184 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: Connected to REDIS... 2025-06-05 Thu 00:45:03:118.193 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.131 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-06-05 Thu 00:45:03:118.203 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: RAC_Connect status: 0 0x1439ba0 2025-06-05 Thu 00:45:03:118.210 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: Connected to REDIS... 2025-06-05 Thu 00:45:03:118.218 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.131 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-06-05 Thu 00:45:03:118.228 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: RAC_Connect status: 0 0x143a4e0 2025-06-05 Thu 00:45:03:118.235 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: Connected to REDIS... 2025-06-05 Thu 00:45:03:118.244 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.131 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-06-05 Thu 00:45:03:118.554 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-06-05 Thu 00:45:03:118.782 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: SANDESH: Send FAILED: 1749084303117586 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.27:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.249:9042, (*_iter6) = 10.0.0.27:9042, (*_iter6) = 10.0.0.131:9042, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ], ] ] ] 2025-06-05 Thu 00:45:03:118.810 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-06-05 Thu 00:45:03:118.831 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: Processing scm::EvTcpConnectFail in state Connect 2025-06-05 Thu 00:45:03:118.845 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: Connect : EvTcpConnectFail 2025-06-05 Thu 00:45:03:119.051 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-06-05 Thu 00:45:03:119.117 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: Idle 2025-06-05 Thu 00:45:03:119.231 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-06-05 Thu 00:45:03:119.460 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: SANDESH: Send FAILED: 1749084303118977 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1749084262921606 collector_name = collector_ip = 10.0.0.249:8086 collector_list= [ [ (*_iter40) = 10.0.0.27:8086, (*_iter40) = 10.0.0.249:8086, (*_iter40) = 10.0.0.131:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 36 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 37, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-06-05 Thu 00:45:03:119.490 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-06-05 Thu 00:45:03:119.509 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-06-05 Thu 00:45:03:119.542 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: SANDESH: Send FAILED: 1749084303119020 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.249:9042, (*_iter6) = 10.0.0.27:9042, (*_iter6) = 10.0.0.131:9042, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ], ] ] ] 2025-06-05 Thu 00:45:03:119.554 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-06-05 Thu 00:45:03:119.578 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-06-05 Thu 00:45:03:119.647 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-06-05 Thu 00:45:03:119.854 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: SANDESH: Send FAILED: 1749084303119213 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1749084262921606 collector_name = collector_ip = 10.0.0.249:8086 collector_list= [ [ (*_iter40) = 10.0.0.27:8086, (*_iter40) = 10.0.0.249:8086, (*_iter40) = 10.0.0.131:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 36 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 38, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-06-05 Thu 00:45:03:119.887 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-06-05 Thu 00:45:03:120.028 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-06-05 Thu 00:45:03:120.108 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: SANDESH: Send FAILED: 1749084303119916 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Database:contrail-query-engine:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 14 dequeues = 14 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1749084303119115 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1749084303119644 ] max_sm_queue_count = 5 ] 2025-06-05 Thu 00:45:03:120.122 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-06-05 Thu 00:45:03:120.136 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-06-05 Thu 00:45:03:120.339 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: SANDESH: Send FAILED: 1749084303120007 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1749084262921606 collector_name = collector_ip = 10.0.0.249:8086 collector_list= [ [ (*_iter40) = 10.0.0.27:8086, (*_iter40) = 10.0.0.249:8086, (*_iter40) = 10.0.0.131:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 36 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 38, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-06-05 Thu 00:45:03:120.363 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-06-05 Thu 00:45:03:121.012 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.249:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-06-05 Thu 00:45:03:121.048 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.249:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-06-05 Thu 00:45:03:121.077 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.249:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-06-05 Thu 00:45:03:121.097 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.249:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-06-05 Thu 00:45:03:121.121 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.27:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-06-05 Thu 00:45:03:121.140 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.27:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-06-05 Thu 00:45:03:121.172 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.249:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-06-05 Thu 00:45:03:121.189 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.249:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-06-05 Thu 00:45:03:121.213 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.249:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-06-05 Thu 00:45:03:121.230 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.249:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-06-05 Thu 00:45:03:121.255 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.249:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-06-05 Thu 00:45:03:121.272 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.249:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-06-05 Thu 00:45:03:121.296 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.27:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-06-05 Thu 00:45:03:121.313 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.27:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-06-05 Thu 00:45:03:121.335 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.27:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-06-05 Thu 00:45:03:121.353 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.27:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-06-05 Thu 00:45:03:121.377 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.27:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-06-05 Thu 00:45:03:121.395 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.27:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-06-05 Thu 00:45:03:121.441 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.27:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-06-05 Thu 00:45:03:121.460 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.27:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-06-05 Thu 00:45:03:121.488 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.131:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-06-05 Thu 00:45:03:121.505 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.131:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-06-05 Thu 00:45:03:121.534 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.131:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-06-05 Thu 00:45:03:121.552 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.131:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-06-05 Thu 00:45:03:121.585 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.131:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-06-05 Thu 00:45:03:121.601 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.131:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-06-05 Thu 00:45:03:121.625 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.131:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-06-05 Thu 00:45:03:121.642 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.131:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-06-05 Thu 00:45:03:121.664 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.131:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-06-05 Thu 00:45:03:121.681 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.131:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-06-05 Thu 00:45:03:121.773 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-06-05 Thu 00:45:03:121.839 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-06-05 Thu 00:45:03:121.875 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-06-05 Thu 00:45:03:121.896 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498723358464, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-06-05 Thu 00:45:03:121.925 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-06-05 Thu 00:45:03:121.957 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498723358464, Pid 1]: SANDESH: Send FAILED: 1749084303121743 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.249:9042, (*_iter6) = 10.0.0.27:9042, (*_iter6) = 10.0.0.131:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.249:6379, (*_iter6) = 10.0.0.27:6379, (*_iter6) = 10.0.0.131:6379, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Collector, Redis-Query:Query connection down ], ] ] ] 2025-06-05 Thu 00:45:03:121.976 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498723358464, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-06-05 Thu 00:45:03:121.995 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498723358464, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-06-05 Thu 00:45:03:122.017 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498723358464, Pid 1]: SANDESH: Send FAILED: 1749084303121816 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.249:9042, (*_iter6) = 10.0.0.27:9042, (*_iter6) = 10.0.0.131:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.249:6379, (*_iter6) = 10.0.0.27:6379, (*_iter6) = 10.0.0.131:6379, ] ] status = Up description = 10.0.0.27:6379::Down.10.0.0.131:6379::Down. ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-06-05 Thu 00:45:03:122.025 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498723358464, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-06-05 Thu 00:45:03:122.035 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498723358464, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-06-05 Thu 00:45:03:122.055 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498723358464, Pid 1]: SANDESH: Send FAILED: 1749084303121913 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.249:9042, (*_iter6) = 10.0.0.27:9042, (*_iter6) = 10.0.0.131:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.249:6379, (*_iter6) = 10.0.0.27:6379, (*_iter6) = 10.0.0.131:6379, ] ] status = Up description = 10.0.0.131:6379::Down. ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-06-05 Thu 00:45:03:122.062 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498723358464, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-06-05 Thu 00:45:03:121.963 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-06-05 Thu 00:45:03:122.321 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-06-05 Thu 00:45:03:122.371 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-06-05 Thu 00:45:03:122.404 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-06-05 Thu 00:45:03:122.432 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-06-05 Thu 00:45:03:122.460 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-06-05 Thu 00:45:03:122.494 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-06-05 Thu 00:45:03:122.585 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-06-05 Thu 00:45:03:122.616 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-06-05 Thu 00:45:03:122.691 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: SANDESH: Send FAILED: 1749084303122536 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.249:9042, (*_iter6) = 10.0.0.27:9042, (*_iter6) = 10.0.0.131:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.249:6379, (*_iter6) = 10.0.0.27:6379, (*_iter6) = 10.0.0.131:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-06-05 Thu 00:45:03:122.703 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-06-05 Thu 00:45:03:122.621 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-06-05 Thu 00:45:03:123.010 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-06-05 Thu 00:45:03:123.037 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-06-05 Thu 00:45:04:119.280 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498761131776, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-06-05 Thu 00:45:04:119.560 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498761131776, Pid 1]: Connect : Start Connect timer 10.0.0.249:8086 2025-06-05 Thu 00:45:04:119.705 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498761131776, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-06-05 Thu 00:45:04:119.741 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498761131776, Pid 1]: SANDESH: Send FAILED: 1749084304119371 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.249:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.249:9042, (*_iter6) = 10.0.0.27:9042, (*_iter6) = 10.0.0.131:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.249:6379, (*_iter6) = 10.0.0.27:6379, (*_iter6) = 10.0.0.131:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-06-05 Thu 00:45:04:119.751 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498761131776, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-06-05 Thu 00:45:04:119.762 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498761131776, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-06-05 Thu 00:45:04:119.941 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498761131776, Pid 1]: SANDESH: Send FAILED: 1749084304119689 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1749084262921606 collector_name = collector_ip = 10.0.0.249:8086 collector_list= [ [ (*_iter40) = 10.0.0.27:8086, (*_iter40) = 10.0.0.249:8086, (*_iter40) = 10.0.0.131:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 81 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 83, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 16, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-06-05 Thu 00:45:04:119.967 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498761131776, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-06-05 Thu 00:45:04:122.199 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.131:34338::10.0.0.249:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280 2025-06-05 Thu 00:45:04:126.139 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: 10.0.0.131:34338::10.0.0.249:8086(-1) OnSessionEvent TCP Connected 2025-06-05 Thu 00:45:04:126.152 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: 10.0.0.131:34338::10.0.0.249:8086(-1):EvTcpConnected 2025-06-05 Thu 00:45:04:126.230 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498761131776, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-06-05 Thu 00:45:04:126.267 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498761131776, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-06-05 Thu 00:45:04:126.314 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498761131776, Pid 1]: ClientInit 2025-06-05 Thu 00:45:04:126.342 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498761131776, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-3401-3.:contrail-query-engine:0:Database count 1 2025-06-05 Thu 00:45:04:126.460 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498761131776, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-06-05 Thu 00:45:04:126.474 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498761131776, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-06-05 Thu 00:45:04:126.501 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498761131776, Pid 1]: SANDESH: Send FAILED: 1749084304126305 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.249:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.249:9042, (*_iter6) = 10.0.0.27:9042, (*_iter6) = 10.0.0.131:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.249:6379, (*_iter6) = 10.0.0.27:6379, (*_iter6) = 10.0.0.131:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-06-05 Thu 00:45:04:126.512 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498761131776, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-06-05 Thu 00:45:04:126.523 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498761131776, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-06-05 Thu 00:45:04:126.531 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498761131776, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-06-05 Thu 00:45:04:126.544 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498761131776, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-06-05 Thu 00:45:04:126.552 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498761131776, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-06-05 Thu 00:45:04:126.706 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498761131776, Pid 1]: SANDESH: Send FAILED: 1749084304126446 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1749084262921606 collector_name = collector_ip = 10.0.0.249:8086 collector_list= [ [ (*_iter40) = 10.0.0.27:8086, (*_iter40) = 10.0.0.249:8086, (*_iter40) = 10.0.0.131:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 81 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 84, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-06-05 Thu 00:45:04:126.727 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498761131776, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-06-05 Thu 00:45:04:133.487 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498756933376, Pid 1]: OnMessage control in state: ClientInit 2025-06-05 Thu 00:45:04:133.568 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498756933376, Pid 1]: Processing scm::EvSandeshMessageRecv in state ClientInit 2025-06-05 Thu 00:45:04:133.589 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498756933376, Pid 1]: ClientInit : EvSandeshMessageRecv 2025-06-05 Thu 00:45:04:133.622 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498756933376, Pid 1]: Received Ctrl Message with size 0 2025-06-05 Thu 00:45:04:133.814 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498756933376, Pid 1]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1749084262921606 collector_name = collector_ip = 10.0.0.249:8086 collector_list= [ [ (*_iter40) = 10.0.0.27:8086, (*_iter40) = 10.0.0.249:8086, (*_iter40) = 10.0.0.131:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 14 dequeues = 14 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1749084303119115 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1749084303119644 ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 81 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 84, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18, _iter59->first = sent _iter59->second = 0, ] ] max_sm_queue_count = 5 proxy seq 10 2025-06-05 Thu 00:45:04:133.845 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498756933376, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2025-06-05 Thu 00:45:04:133.877 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498756933376, Pid 1]: SyncUVE Syncing ObjectDatabaseInfo val name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.249:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.249:9042, (*_iter6) = 10.0.0.27:9042, (*_iter6) = 10.0.0.131:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.249:6379, (*_iter6) = 10.0.0.27:6379, (*_iter6) = 10.0.0.131:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] proxy seq 11 2025-06-05 Thu 00:45:04:133.891 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498756933376, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2025-06-05 Thu 00:45:04:133.904 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498756933376, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 without seqno , total = 0 2025-06-05 Thu 00:45:04:133.913 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498756933376, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0 2025-06-05 Thu 00:45:04:133.955 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498756933376, Pid 1]: Established 2025-06-05 Thu 00:45:11:677.426 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498241054464, Pid 1]: OnMessage control in state: Established 2025-06-05 Thu 00:45:11:677.582 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498782123776, Pid 1]: Processing scm::EvSandeshMessageRecv in state Established 2025-06-05 Thu 00:45:11:677.645 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498782123776, Pid 1]: Established : EvSandeshMessageRecv 2025-06-05 Thu 00:45:11:677.708 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498782123776, Pid 1]: Received Ctrl Message with size 3 2025-06-05 Thu 00:45:11:677.730 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498782123776, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 with seqno 11, total = 0 2025-06-05 Thu 00:45:11:677.743 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498782123776, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 with seqno 13, total = 0 2025-06-05 Thu 00:45:11:677.758 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498782123776, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 with seqno 1, total = 0 2025-06-05 Thu 00:45:11:677.769 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498782123776, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0 2025-06-05 Thu 00:45:33:120.293 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498863077120, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 1 without seqno , total = 0 2025-06-05 Thu 00:46:33:120.956 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498241054464, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 2 without seqno , total = 0 2025-06-05 Thu 00:47:12:195.302 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.131:8091::10.0.0.131:37866 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-06-05 Thu 00:47:33:121.992 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498777925376, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 3 without seqno , total = 0 2025-06-05 Thu 00:47:50:619.704 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.131:8091::10.0.0.131:50044 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-06-05 Thu 00:48:33:122.881 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498756933376, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 4 without seqno , total = 0 2025-06-05 Thu 00:49:33:123.643 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498727556864, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 5 without seqno , total = 0 2025-06-05 Thu 00:50:33:124.257 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498245252864, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 6 without seqno , total = 0 2025-06-05 Thu 00:51:33:124.950 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498765330176, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 7 without seqno , total = 0 2025-06-05 Thu 00:52:33:125.526 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498245252864, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 8 without seqno , total = 0 2025-06-05 Thu 00:53:33:126.323 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498756933376, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 9 without seqno , total = 0 2025-06-05 Thu 00:54:33:126.944 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498863077120, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 10 without seqno , total = 0 2025-06-05 Thu 00:55:33:127.638 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498863077120, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 11 without seqno , total = 0 2025-06-05 Thu 00:56:33:128.289 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498782123776, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 12 without seqno , total = 0 2025-06-05 Thu 00:57:33:128.862 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498236856064, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 13 without seqno , total = 0 2025-06-05 Thu 00:58:33:129.480 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498782123776, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 14 without seqno , total = 0 2025-06-05 Thu 00:59:33:130.482 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498773726976, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 15 without seqno , total = 0 2025-06-05 Thu 01:00:33:131.041 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498241054464, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 16 without seqno , total = 0 2025-06-05 Thu 01:01:33:131.616 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498765330176, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 17 without seqno , total = 0 2025-06-05 Thu 01:02:33:132.802 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498232657664, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 18 without seqno , total = 0 2025-06-05 Thu 01:03:33:133.408 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498241054464, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 19 without seqno , total = 0 2025-06-05 Thu 01:04:33:134.762 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498245252864, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 20 without seqno , total = 0 2025-06-05 Thu 01:05:33:136.948 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 21 without seqno , total = 0 2025-06-05 Thu 01:06:33:137.511 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 22 without seqno , total = 0 2025-06-05 Thu 01:07:33:138.053 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498241054464, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 23 without seqno , total = 0 2025-06-05 Thu 01:08:33:140.833 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498777925376, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 24 without seqno , total = 0 2025-06-05 Thu 01:09:33:141.383 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498777925376, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 25 without seqno , total = 0 2025-06-05 Thu 01:10:33:141.976 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498727556864, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 26 without seqno , total = 0 2025-06-05 Thu 01:11:33:142.580 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498245252864, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 27 without seqno , total = 0 2025-06-05 Thu 01:12:33:143.181 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498236856064, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 28 without seqno , total = 0 2025-06-05 Thu 01:13:33:144.434 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498232657664, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 29 without seqno , total = 0 2025-06-05 Thu 01:14:33:145.048 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498723358464, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 30 without seqno , total = 0 2025-06-05 Thu 01:15:33:145.611 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498245252864, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 31 without seqno , total = 0 2025-06-05 Thu 01:16:33:146.142 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498777925376, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 32 without seqno , total = 0 2025-06-05 Thu 01:17:33:146.805 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498241054464, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 33 without seqno , total = 0 2025-06-05 Thu 01:18:33:147.963 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498241054464, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 34 without seqno , total = 0 2025-06-05 Thu 01:19:33:148.514 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498245252864, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 35 without seqno , total = 0 2025-06-05 Thu 01:20:33:149.106 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498232657664, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 36 without seqno , total = 0 2025-06-05 Thu 01:21:33:149.737 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498777925376, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 37 without seqno , total = 0 2025-06-05 Thu 01:22:33:150.275 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498245252864, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 38 without seqno , total = 0 2025-06-05 Thu 01:23:33:151.436 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498245252864, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 39 without seqno , total = 0 2025-06-05 Thu 01:24:33:151.989 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498858878720, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 40 without seqno , total = 0 2025-06-05 Thu 01:25:33:152.613 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498232657664, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 41 without seqno , total = 0 2025-06-05 Thu 01:26:33:153.188 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498863077120, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 42 without seqno , total = 0 2025-06-05 Thu 01:27:33:153.756 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498761131776, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 43 without seqno , total = 0 2025-06-05 Thu 01:28:33:154.287 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498761131776, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 44 without seqno , total = 0 2025-06-05 Thu 01:29:33:154.863 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498761131776, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 45 without seqno , total = 0 2025-06-05 Thu 01:30:33:155.442 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498773726976, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 46 without seqno , total = 0 2025-06-05 Thu 01:31:33:155.958 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498761131776, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 47 without seqno , total = 0 2025-06-05 Thu 01:32:33:156.696 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498727556864, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 48 without seqno , total = 0 2025-06-05 Thu 01:33:33:157.234 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498241054464, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 49 without seqno , total = 0 2025-06-05 Thu 01:34:33:157.793 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498769528576, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 50 without seqno , total = 0 2025-06-05 Thu 01:35:33:158.306 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498854680320, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 51 without seqno , total = 0 2025-06-05 Thu 01:36:33:158.903 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498854680320, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 52 without seqno , total = 0 2025-06-05 Thu 01:37:33:159.543 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498245252864, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 53 without seqno , total = 0 2025-06-05 Thu 01:38:33:160.081 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498241054464, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 54 without seqno , total = 0 2025-06-05 Thu 01:39:33:160.658 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498854680320, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 55 without seqno , total = 0 2025-06-05 Thu 01:40:33:161.257 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498245252864, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 56 without seqno , total = 0 2025-06-05 Thu 01:41:33:163.772 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498854680320, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 57 without seqno , total = 0 2025-06-05 Thu 01:42:33:164.368 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498241054464, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 58 without seqno , total = 0 2025-06-05 Thu 01:43:33:165.044 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140498863077120, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 59 without seqno , total = 0 2025-06-05 Thu 01:43:53:695.737 UTC cn-jenkins-deploy-platform-ansible-os-3401-3 [Thread 140499006748800, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.131:8091::10.0.0.131:33664 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254