2025-05-08 Thu 01:59:16:496.544 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: http-server-port 8091 2025-05-08 Thu 01:59:16:496.639 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: Max-tasks 16 2025-05-08 Thu 01:59:16:496.646 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: Max-slice 100 2025-05-08 Thu 01:59:16:496.652 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: Collectors 10.0.0.50:8086 2025-05-08 Thu 01:59:16:496.673 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: SANDESH: ROLE : Generator 2025-05-08 Thu 01:59:16:496.679 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: SANDESH: MODULE : contrail-query-engine 2025-05-08 Thu 01:59:16:496.684 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: SANDESH: SOURCE : cn-jenkins-deploy-platform-juju-k8s-1220-1 2025-05-08 Thu 01:59:16:496.689 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: SANDESH: NODE TYPE : Database 2025-05-08 Thu 01:59:16:496.694 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: SANDESH: INSTANCE ID : 0 2025-05-08 Thu 01:59:16:496.698 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: SANDESH: HTTP SERVER PORT : 8091 2025-05-08 Thu 01:59:16:496.704 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: SANDESH: System Log Send Rate Limit: 0 -> 0 2025-05-08 Thu 01:59:16:497.333 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: HTTP Introspect Init 2025-05-08 Thu 01:59:16:497.500 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8091 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-05-08 Thu 01:59:16:497.577 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: Sandesh Http Server Port: 8091 2025-05-08 Thu 01:59:16:497.617 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: SANDESH: NOT Writing http_port 8091TO : /tmp/contrail-query-engine.0.http_port 2025-05-08 Thu 01:59:16:497.626 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: SANDESH: CONNECT TO COLLECTOR: 1 2025-05-08 Thu 01:59:16:497.702 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: Idle 2025-05-08 Thu 01:59:16:497.855 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: SANDESH: No Client: 1746669556497786 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1220-1:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1746669556497711 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 0, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-05-08 Thu 01:59:16:497.976 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: SANDESH: Logging: DISABLED -> ENABLED 2025-05-08 Thu 01:59:16:497.989 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ] 2025-05-08 Thu 01:59:16:497.999 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: Cassandra Servers: 10.0.0.50:9042 2025-05-08 Thu 01:59:16:498.103 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Processing scm::EvStart in state Idle 2025-05-08 Thu 01:59:16:504.416 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-05-08 Thu 01:59:16:504.447 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-05-08 Thu 01:59:16:504.498 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 0 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-05-08 Thu 01:59:16:505.271 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Disconnect 2025-05-08 Thu 01:59:16:505.364 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Processing scm::EvCollectorUpdate in state Disconnect 2025-05-08 Thu 01:59:16:505.550 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Connect : Start Connect timer 10.0.0.50:8086 2025-05-08 Thu 01:59:16:505.615 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-05-08 Thu 01:59:16:505.634 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: SANDESH: Send FAILED: 1746669556504483 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1220-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.50:9042, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Number of connections:1, Expected:3 Missing: Redis-Query:Query,Collector ], ] ] ] 2025-05-08 Thu 01:59:16:505.643 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-05-08 Thu 01:59:16:505.651 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-05-08 Thu 01:59:16:505.667 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: SANDESH: Send FAILED: 1746669556505257 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1220-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Idle : EvStart -> Disconnect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.50:9042, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ], ] ] ] 2025-05-08 Thu 01:59:16:505.680 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-05-08 Thu 01:59:16:505.687 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-05-08 Thu 01:59:16:505.797 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: SANDESH: Send FAILED: 1746669556505354 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1220-1:Database:contrail-query-engine:0 client_info= [ status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1746669556497711 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 4, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-05-08 Thu 01:59:16:505.818 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-05-08 Thu 01:59:16:505.828 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-05-08 Thu 01:59:16:505.899 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: SANDESH: Send FAILED: 1746669556505404 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1220-1:Database:contrail-query-engine:0 client_info= [ status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1746669556497711 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 4, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-05-08 Thu 01:59:16:505.908 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-05-08 Thu 01:59:16:505.916 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-05-08 Thu 01:59:16:505.945 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: SANDESH: Send FAILED: 1746669556505420 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1220-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.50:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.50:9042, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ], ] ] ] 2025-05-08 Thu 01:59:16:505.955 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-05-08 Thu 01:59:16:505.963 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-05-08 Thu 01:59:16:506.027 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: SANDESH: Send FAILED: 1746669556505605 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1220-1:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1746669556497711 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 4, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-05-08 Thu 01:59:16:506.038 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-05-08 Thu 01:59:21:507.390 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-05-08 Thu 01:59:21:507.430 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-05-08 Thu 01:59:21:507.455 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 1 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-05-08 Thu 01:59:26:515.006 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-05-08 Thu 01:59:26:515.055 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-05-08 Thu 01:59:26:515.080 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 2 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-05-08 Thu 01:59:31:521.542 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-05-08 Thu 01:59:31:521.590 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-05-08 Thu 01:59:31:521.609 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 3 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-05-08 Thu 01:59:36:719.808 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004 2025-05-08 Thu 01:59:36:719.852 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-05-08 Thu 01:59:36:719.872 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 4 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-05-08 Thu 01:59:41:957.760 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-05-08 Thu 01:59:41:957.816 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 5 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-05-08 Thu 01:59:47:098.620 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-05-08 Thu 01:59:47:098.683 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 6 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-05-08 Thu 01:59:52:135.349 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: Older table does not exist. will query only the new table src/contrail-analytics/contrail-query-engine/query.cc 1037 2025-05-08 Thu 01:59:52:135.404 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 7 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-05-08 Thu 01:59:57:426.486 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: Older table does not exist. will query only the new table src/contrail-analytics/contrail-query-engine/query.cc 1037 2025-05-08 Thu 02:00:02:439.608 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-05-08 Thu 02:00:02:477.011 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: SANDESH: Send FAILED: 1746669602439533 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1220-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.50:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.50:9042, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ], ] ] ] 2025-05-08 Thu 02:00:02:477.046 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-05-08 Thu 02:00:02:441.488 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:50610 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:00:02:520.305 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: RAC_Connect status: 0 0xda0140 2025-05-08 Thu 02:00:02:520.331 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: Connected to REDIS... 2025-05-08 Thu 02:00:02:520.351 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-05-08 Thu 02:00:02:520.367 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: RAC_Connect status: 0 0xda0840 2025-05-08 Thu 02:00:02:520.372 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: Connected to REDIS... 2025-05-08 Thu 02:00:02:520.381 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-05-08 Thu 02:00:02:520.390 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: RAC_Connect status: 0 0xda1050 2025-05-08 Thu 02:00:02:520.396 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: Connected to REDIS... 2025-05-08 Thu 02:00:02:520.408 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-05-08 Thu 02:00:02:520.426 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: RAC_Connect status: 0 0xda1880 2025-05-08 Thu 02:00:02:520.431 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: Connected to REDIS... 2025-05-08 Thu 02:00:02:520.438 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-05-08 Thu 02:00:02:520.447 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: RAC_Connect status: 0 0xda2100 2025-05-08 Thu 02:00:02:520.452 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: Connected to REDIS... 2025-05-08 Thu 02:00:02:520.459 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-05-08 Thu 02:00:02:520.488 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: -(-1) OnSessionEvent TCP Connect Failed 2025-05-08 Thu 02:00:02:520.495 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: -(-1):EvTcpConnectFail 2025-05-08 Thu 02:00:02:522.574 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:33526 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:00:02:523.408 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Processing scm::EvTcpConnectFail in state Connect 2025-05-08 Thu 02:00:02:523.429 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Connect : EvTcpConnectFail 2025-05-08 Thu 02:00:02:523.482 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314 2025-05-08 Thu 02:00:02:523.525 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Idle 2025-05-08 Thu 02:00:02:523.599 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-05-08 Thu 02:00:02:523.620 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: SANDESH: Send FAILED: 1746669602523458 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1220-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.50:9042, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ], ] ] ] 2025-05-08 Thu 02:00:02:526.448 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-05-08 Thu 02:00:02:525.145 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:42576 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:00:02:644.096 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-05-08 Thu 02:00:02:644.193 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-05-08 Thu 02:00:02:644.290 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-05-08 Thu 02:00:02:644.324 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-05-08 Thu 02:00:02:644.334 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: SANDESH: Send FAILED: 1746669602523588 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1220-1:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1746669556497711 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 27 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 31, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-05-08 Thu 02:00:02:644.367 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-05-08 Thu 02:00:02:644.494 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-05-08 Thu 02:00:02:644.556 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: SANDESH: Send FAILED: 1746669602644401 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1220-1:Database:contrail-query-engine:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 9 dequeues = 9 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 13 dequeues = 13 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1746669602523524 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1746669602644191 ] max_sm_queue_count = 6 ] 2025-05-08 Thu 02:00:02:644.566 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-05-08 Thu 02:00:02:644.577 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-05-08 Thu 02:00:02:644.347 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-05-08 Thu 02:00:02:644.617 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-05-08 Thu 02:00:02:644.636 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-05-08 Thu 02:00:02:644.647 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-05-08 Thu 02:00:02:644.660 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-05-08 Thu 02:00:02:644.670 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-05-08 Thu 02:00:02:644.689 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-05-08 Thu 02:00:02:644.700 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-05-08 Thu 02:00:02:644.755 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: SANDESH: Send FAILED: 1746669602644472 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1220-1:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1746669556497711 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 30 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 35, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 9, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-05-08 Thu 02:00:02:644.775 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-05-08 Thu 02:00:02:644.779 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-05-08 Thu 02:00:02:644.822 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-05-08 Thu 02:00:02:644.822 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-05-08 Thu 02:00:02:644.849 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: SANDESH: Send FAILED: 1746669602644759 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1220-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.50:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.50:6379, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Collector, Redis-Query:Query connection down ], ] ] ] 2025-05-08 Thu 02:00:02:644.849 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-05-08 Thu 02:00:02:644.875 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-05-08 Thu 02:00:02:644.884 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-05-08 Thu 02:00:02:644.861 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-05-08 Thu 02:00:02:644.909 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-05-08 Thu 02:00:02:644.926 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: SANDESH: Send FAILED: 1746669602644815 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1220-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.50:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.50:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-05-08 Thu 02:00:02:644.935 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-05-08 Thu 02:00:02:645.036 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:50610 > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314 2025-05-08 Thu 02:00:02:645.091 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:33526 > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314 2025-05-08 Thu 02:00:02:645.138 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:42576 > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314 2025-05-08 Thu 02:00:03:523.787 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638343382784, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-05-08 Thu 02:00:03:524.019 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638343382784, Pid 1]: Connect : Start Connect timer 10.0.0.50:8086 2025-05-08 Thu 02:00:03:524.111 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638343382784, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-05-08 Thu 02:00:03:524.139 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638343382784, Pid 1]: SANDESH: Send FAILED: 1746669603523851 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1220-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.50:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.50:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.50:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-05-08 Thu 02:00:03:524.149 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638343382784, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-05-08 Thu 02:00:03:524.157 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638343382784, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-05-08 Thu 02:00:03:524.262 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638343382784, Pid 1]: SANDESH: Send FAILED: 1746669603524100 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1220-1:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1746669556497711 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 42 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 50, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 13, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-05-08 Thu 02:00:03:524.279 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638343382784, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-05-08 Thu 02:00:03:531.040 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:46964::10.0.0.50:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-05-08 Thu 02:00:03:531.074 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: 10.0.0.50:46964::10.0.0.50:8086(-1) OnSessionEvent TCP Connected 2025-05-08 Thu 02:00:03:531.082 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: 10.0.0.50:46964::10.0.0.50:8086(-1):EvTcpConnected 2025-05-08 Thu 02:00:03:533.187 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638334985984, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-05-08 Thu 02:00:03:533.271 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638334985984, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-05-08 Thu 02:00:03:533.323 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638334985984, Pid 1]: ClientInit 2025-05-08 Thu 02:00:03:533.345 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638334985984, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-k8s-1220-1:contrail-query-engine:0:Database count 1 2025-05-08 Thu 02:00:03:533.452 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638334985984, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-05-08 Thu 02:00:03:533.466 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638334985984, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-05-08 Thu 02:00:03:533.496 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638334985984, Pid 1]: SANDESH: Send FAILED: 1746669603533312 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1220-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.50:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.50:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.50:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-05-08 Thu 02:00:03:533.506 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638334985984, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-05-08 Thu 02:00:03:533.517 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638334985984, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-05-08 Thu 02:00:03:533.526 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638334985984, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-05-08 Thu 02:00:03:533.553 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638334985984, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-05-08 Thu 02:00:03:533.561 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638334985984, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-05-08 Thu 02:00:03:533.689 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638334985984, Pid 1]: SANDESH: Send FAILED: 1746669603533438 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1220-1:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1746669556497711 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 42 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 51, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 15, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-05-08 Thu 02:00:03:533.711 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638334985984, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-05-08 Thu 02:00:03:540.789 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638309795584, Pid 1]: OnMessage control in state: ClientInit 2025-05-08 Thu 02:00:03:544.196 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638454920960, Pid 1]: Processing scm::EvSandeshMessageRecv in state ClientInit 2025-05-08 Thu 02:00:03:544.227 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638454920960, Pid 1]: ClientInit : EvSandeshMessageRecv 2025-05-08 Thu 02:00:03:544.267 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638454920960, Pid 1]: Received Ctrl Message with size 0 2025-05-08 Thu 02:00:03:544.436 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638454920960, Pid 1]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-juju-k8s-1220-1:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1746669556497711 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 9 dequeues = 9 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 13 dequeues = 13 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1746669602523524 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1746669602644191 ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 42 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 51, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 15, _iter59->first = sent _iter59->second = 0, ] ] max_sm_queue_count = 6 proxy seq 9 2025-05-08 Thu 02:00:03:544.464 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638454920960, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2025-05-08 Thu 02:00:03:544.489 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638454920960, Pid 1]: SyncUVE Syncing ObjectDatabaseInfo val name = cn-jenkins-deploy-platform-juju-k8s-1220-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.50:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.50:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.50:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] proxy seq 9 2025-05-08 Thu 02:00:03:544.501 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638454920960, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2025-05-08 Thu 02:00:03:544.510 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638454920960, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 without seqno , total = 0 2025-05-08 Thu 02:00:03:544.519 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638454920960, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0 2025-05-08 Thu 02:00:03:544.553 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638454920960, Pid 1]: Established 2025-05-08 Thu 02:00:06:585.958 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:44994 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:00:13:726.567 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:45082 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:00:21:670.962 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:45092 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:00:28:727.614 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:35500 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:00:32:659.027 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638318192384, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 1 without seqno , total = 0 2025-05-08 Thu 02:00:33:597.683 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:54120 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:00:38:307.367 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:54122 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:01:17:898.415 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:51242 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:01:32:659.922 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638309795584, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 2 without seqno , total = 0 2025-05-08 Thu 02:02:32:660.502 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638322390784, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 3 without seqno , total = 0 2025-05-08 Thu 02:02:57:470.982 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:36186 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:03:32:662.411 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638309795584, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 4 without seqno , total = 0 2025-05-08 Thu 02:03:40:749.472 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:34746 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:04:06:260.527 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:59126 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:04:32:663.841 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638326589184, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 5 without seqno , total = 0 2025-05-08 Thu 02:05:32:664.396 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 6 without seqno , total = 0 2025-05-08 Thu 02:06:32:665.258 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638330787584, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 7 without seqno , total = 0 2025-05-08 Thu 02:06:50:666.704 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:60850 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:07:16:843.591 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:46940 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:07:32:666.083 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638450722560, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 8 without seqno , total = 0 2025-05-08 Thu 02:08:19:272.706 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:35536 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:08:24:202.287 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:59602 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:08:32:666.652 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638330787584, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 9 without seqno , total = 0 2025-05-08 Thu 02:09:32:667.183 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638318192384, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 10 without seqno , total = 0 2025-05-08 Thu 02:10:32:667.748 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638450722560, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 11 without seqno , total = 0 2025-05-08 Thu 02:11:32:668.398 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638463317760, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 12 without seqno , total = 0 2025-05-08 Thu 02:12:14:259.278 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:54472 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:12:32:669.011 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638450722560, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 13 without seqno , total = 0 2025-05-08 Thu 02:12:41:974.406 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:34262 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:13:19:598.301 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:57664 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:13:24:511.597 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:47002 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:13:32:669.607 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638326589184, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 14 without seqno , total = 0 2025-05-08 Thu 02:14:32:670.163 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638326589184, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 15 without seqno , total = 0 2025-05-08 Thu 02:15:32:671.312 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638343382784, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 16 without seqno , total = 0 2025-05-08 Thu 02:16:32:671.918 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638343382784, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 17 without seqno , total = 0 2025-05-08 Thu 02:16:54:689.451 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:34550 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:17:27:657.893 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:43558 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:17:31:832.635 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:43560 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:17:32:672.469 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638334985984, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 18 without seqno , total = 0 2025-05-08 Thu 02:18:26:194.740 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:44808 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:18:32:673.532 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638334985984, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 19 without seqno , total = 0 2025-05-08 Thu 02:19:32:674.088 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638318192384, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 20 without seqno , total = 0 2025-05-08 Thu 02:20:32:675.410 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638309795584, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 21 without seqno , total = 0 2025-05-08 Thu 02:21:32:679.754 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638318192384, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 22 without seqno , total = 0 2025-05-08 Thu 02:22:30:344.475 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:54732 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:22:32:680.633 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638322390784, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 23 without seqno , total = 0 2025-05-08 Thu 02:22:35:712.232 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:36600 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:22:40:609.817 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:36612 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:23:16:267.135 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:50620 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:23:32:681.189 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638313993984, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 24 without seqno , total = 0 2025-05-08 Thu 02:24:32:685.720 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638467516160, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 25 without seqno , total = 0 2025-05-08 Thu 02:25:32:688.840 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638343382784, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 26 without seqno , total = 0 2025-05-08 Thu 02:26:32:689.443 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638450722560, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 27 without seqno , total = 0 2025-05-08 Thu 02:27:18:699.440 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:50026 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:27:23:690.464 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:41786 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:27:32:690.487 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638441461504, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 28 without seqno , total = 0 2025-05-08 Thu 02:28:08:741.730 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:34712 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:28:32:691.083 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638313993984, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 29 without seqno , total = 0 2025-05-08 Thu 02:28:35:570.156 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:59160 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:28:39:820.611 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:59170 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:28:42:357.947 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:40238 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:29:27:799.649 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:36200 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:29:32:694.307 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638441461504, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 30 without seqno , total = 0 2025-05-08 Thu 02:29:54:127.980 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:37914 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-08 Thu 02:30:32:694.876 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638454920960, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 31 without seqno , total = 0 2025-05-08 Thu 02:31:17:819.532 UTC cn-jenkins-deploy-platform-juju-k8s-1220-1 [Thread 140638615378048, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:41680 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256