2024-12-23 Mon 01:48:21:112.471 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: http-server-port 8091 2024-12-23 Mon 01:48:21:112.673 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: Max-tasks 16 2024-12-23 Mon 01:48:21:112.683 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: Max-slice 100 2024-12-23 Mon 01:48:21:112.688 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: Collectors 10.0.0.12:8086 2024-12-23 Mon 01:48:21:112.719 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: SANDESH: ROLE : Generator 2024-12-23 Mon 01:48:21:112.725 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: SANDESH: MODULE : contrail-query-engine 2024-12-23 Mon 01:48:21:112.730 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: SANDESH: SOURCE : cn-jenkins-deploy-platform-juju-os-458-1 2024-12-23 Mon 01:48:21:112.735 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: SANDESH: NODE TYPE : Database 2024-12-23 Mon 01:48:21:112.740 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: SANDESH: INSTANCE ID : 0 2024-12-23 Mon 01:48:21:112.745 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: SANDESH: HTTP SERVER PORT : 8091 2024-12-23 Mon 01:48:21:112.751 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: SANDESH: System Log Send Rate Limit: 0 -> 0 2024-12-23 Mon 01:48:21:114.327 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: HTTP Introspect Init 2024-12-23 Mon 01:48:21:114.575 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8091 Initialization complete src/contrail-common/io/tcp_server.cc 137 2024-12-23 Mon 01:48:21:114.654 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: Sandesh Http Server Port: 8091 2024-12-23 Mon 01:48:21:114.699 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: SANDESH: NOT Writing http_port 8091TO : /tmp/contrail-query-engine.0.http_port 2024-12-23 Mon 01:48:21:114.709 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: SANDESH: CONNECT TO COLLECTOR: 1 2024-12-23 Mon 01:48:21:114.810 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: Idle 2024-12-23 Mon 01:48:21:115.518 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: SANDESH: No Client: 1734918501114897 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-458-1:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1734918501114821 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 0, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2024-12-23 Mon 01:48:21:115.922 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: SANDESH: Logging: DISABLED -> ENABLED 2024-12-23 Mon 01:48:21:115.943 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ] 2024-12-23 Mon 01:48:21:115.956 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: Cassandra Servers: 10.0.0.12:9042 2024-12-23 Mon 01:48:21:117.939 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709380048640, Pid 1]: Processing scm::EvStart in state Idle 2024-12-23 Mon 01:48:21:118.956 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709380048640, Pid 1]: Disconnect 2024-12-23 Mon 01:48:21:119.281 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709380048640, Pid 1]: Processing scm::EvCollectorUpdate in state Disconnect 2024-12-23 Mon 01:48:21:120.108 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709380048640, Pid 1]: Connect : Start Connect timer 10.0.0.12:8086 2024-12-23 Mon 01:48:21:120.191 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709380048640, Pid 1]: Processing scm::EvSandeshSend in state Connect 2024-12-23 Mon 01:48:21:120.222 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709380048640, Pid 1]: SANDESH: Send FAILED: 1734918501118937 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-458-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Idle : EvStart -> Disconnect ], ] ] flag_infos= [ [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ], ] ] ] 2024-12-23 Mon 01:48:21:120.232 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709380048640, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2024-12-23 Mon 01:48:21:120.241 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709380048640, Pid 1]: Processing scm::EvSandeshSend in state Connect 2024-12-23 Mon 01:48:21:120.322 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709380048640, Pid 1]: SANDESH: Send FAILED: 1734918501119266 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-458-1:Database:contrail-query-engine:0 client_info= [ status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1734918501114821 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2024-12-23 Mon 01:48:21:120.339 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709380048640, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2024-12-23 Mon 01:48:21:120.348 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709380048640, Pid 1]: Processing scm::EvSandeshSend in state Connect 2024-12-23 Mon 01:48:21:120.417 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709380048640, Pid 1]: SANDESH: Send FAILED: 1734918501119336 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-458-1:Database:contrail-query-engine:0 client_info= [ status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1734918501114821 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2024-12-23 Mon 01:48:21:120.429 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709380048640, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2024-12-23 Mon 01:48:21:120.439 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709380048640, Pid 1]: Processing scm::EvSandeshSend in state Connect 2024-12-23 Mon 01:48:21:120.456 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709380048640, Pid 1]: SANDESH: Send FAILED: 1734918501119356 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-458-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.12:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], ] ] flag_infos= [ [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ], ] ] ] 2024-12-23 Mon 01:48:21:120.462 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709380048640, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2024-12-23 Mon 01:48:21:120.469 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709380048640, Pid 1]: Processing scm::EvSandeshSend in state Connect 2024-12-23 Mon 01:48:21:120.532 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709380048640, Pid 1]: SANDESH: Send FAILED: 1734918501120178 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-458-1:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1734918501114821 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2024-12-23 Mon 01:48:21:120.543 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709380048640, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2024-12-23 Mon 01:48:21:127.987 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: RAC_Connect: redisSecureConnection() failed: SSL_connect() failed 2024-12-23 Mon 01:48:21:128.401 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: RAC_Connect: redisSecureConnection() failed: SSL_connect() failed 2024-12-23 Mon 01:48:21:128.709 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: RAC_Connect: redisSecureConnection() failed: SSL_connect() failed 2024-12-23 Mon 01:48:21:128.983 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: RAC_Connect: redisSecureConnection() failed: SSL_connect() failed 2024-12-23 Mon 01:48:21:129.216 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: RAC_Connect: redisSecureConnection() failed: SSL_connect() failed 2024-12-23 Mon 01:48:21:154.592 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2024-12-23 Mon 01:48:21:154.640 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2024-12-23 Mon 01:48:21:166.880 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709380048640, Pid 1]: Processing scm::EvSandeshSend in state Connect 2024-12-23 Mon 01:48:21:166.959 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709380048640, Pid 1]: SANDESH: Send FAILED: 1734918501154696 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-458-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.12:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.12:9042, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ], ] ] ] 2024-12-23 Mon 01:48:21:166.973 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709380048640, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2024-12-23 Mon 01:48:21:167.011 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 0 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2024-12-23 Mon 01:48:26:171.552 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2024-12-23 Mon 01:48:26:171.602 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2024-12-23 Mon 01:48:26:171.635 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 1 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2024-12-23 Mon 01:48:31:172.972 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2024-12-23 Mon 01:48:31:173.020 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2024-12-23 Mon 01:48:31:173.041 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 2 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2024-12-23 Mon 01:48:36:174.156 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2024-12-23 Mon 01:48:36:174.216 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2024-12-23 Mon 01:48:36:174.244 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 3 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2024-12-23 Mon 01:48:41:586.061 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004 2024-12-23 Mon 01:48:41:586.100 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2024-12-23 Mon 01:48:41:586.121 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 4 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2024-12-23 Mon 01:48:46:673.575 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004 2024-12-23 Mon 01:48:46:673.643 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2024-12-23 Mon 01:48:46:673.670 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 5 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2024-12-23 Mon 01:48:51:729.304 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004 2024-12-23 Mon 01:48:51:729.445 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2024-12-23 Mon 01:48:51:729.465 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 6 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2024-12-23 Mon 01:48:56:783.584 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004 2024-12-23 Mon 01:48:56:783.652 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2024-12-23 Mon 01:48:56:783.681 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 7 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2024-12-23 Mon 01:49:01:852.632 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004 2024-12-23 Mon 01:49:01:852.677 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2024-12-23 Mon 01:49:01:852.702 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 8 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2024-12-23 Mon 01:49:06:902.265 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004 2024-12-23 Mon 01:49:06:902.316 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2024-12-23 Mon 01:49:06:902.336 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 9 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2024-12-23 Mon 01:49:11:940.384 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004 2024-12-23 Mon 01:49:11:940.445 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2024-12-23 Mon 01:49:11:940.465 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 10 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2024-12-23 Mon 01:49:17:005.331 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004 2024-12-23 Mon 01:49:17:005.397 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2024-12-23 Mon 01:49:17:005.418 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 11 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2024-12-23 Mon 01:49:22:138.997 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004 2024-12-23 Mon 01:49:22:139.046 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2024-12-23 Mon 01:49:22:139.067 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 12 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2024-12-23 Mon 01:49:28:214.184 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2024-12-23 Mon 01:49:28:214.243 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 13 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2024-12-23 Mon 01:49:33:557.461 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2024-12-23 Mon 01:49:33:557.519 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 14 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2024-12-23 Mon 01:49:39:046.823 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2024-12-23 Mon 01:49:39:047.196 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 15 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2024-12-23 Mon 01:49:44:171.549 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: Older table does not exist. will query only the new table src/contrail-analytics/contrail-query-engine/query.cc 1037 2024-12-23 Mon 01:49:44:171.602 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 16 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2024-12-23 Mon 01:49:49:240.524 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: Older table does not exist. will query only the new table src/contrail-analytics/contrail-query-engine/query.cc 1037 2024-12-23 Mon 01:49:54:246.189 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708696872704, Pid 1]: Processing scm::EvSandeshSend in state Connect 2024-12-23 Mon 01:49:54:246.262 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708696872704, Pid 1]: SANDESH: Send FAILED: 1734918594246076 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-458-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.12:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.12:9042, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ], ] ] ] 2024-12-23 Mon 01:49:54:246.273 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708696872704, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2024-12-23 Mon 01:49:54:248.731 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: -(-1) OnSessionEvent TCP Connect Failed 2024-12-23 Mon 01:49:54:248.773 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: -(-1):EvTcpConnectFail 2024-12-23 Mon 01:49:54:248.819 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x200d7b0 2024-12-23 Mon 01:49:54:248.862 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709371651840, Pid 1]: Processing scm::EvTcpConnectFail in state Connect 2024-12-23 Mon 01:49:54:248.901 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709371651840, Pid 1]: Connect : EvTcpConnectFail 2024-12-23 Mon 01:49:54:249.068 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709371651840, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314 2024-12-23 Mon 01:49:54:249.138 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709371651840, Pid 1]: Idle 2024-12-23 Mon 01:49:54:249.285 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x2025af0 2024-12-23 Mon 01:49:54:249.587 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709371651840, Pid 1]: Processing scm::EvSandeshSend in state Idle 2024-12-23 Mon 01:49:54:249.627 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709371651840, Pid 1]: SANDESH: Send FAILED: 1734918594248933 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-458-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.12:9042, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ], ] ] ] 2024-12-23 Mon 01:49:54:249.635 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709371651840, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2024-12-23 Mon 01:49:54:249.644 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709371651840, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2024-12-23 Mon 01:49:54:249.680 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709371651840, Pid 1]: Processing scm::EvSandeshSend in state Idle 2024-12-23 Mon 01:49:54:249.595 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x2039380 2024-12-23 Mon 01:49:54:249.818 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709371651840, Pid 1]: SANDESH: Send FAILED: 1734918594249571 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-458-1:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1734918501114821 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 48 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 50, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7, _iter59->first = sent _iter59->second = 0, ] ] ] 2024-12-23 Mon 01:49:54:249.836 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709371651840, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2024-12-23 Mon 01:49:54:249.919 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709371651840, Pid 1]: Processing scm::EvSandeshSend in state Idle 2024-12-23 Mon 01:49:54:249.963 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709371651840, Pid 1]: SANDESH: Send FAILED: 1734918594249859 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-458-1:Database:contrail-query-engine:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 9 dequeues = 9 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 13 dequeues = 13 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1734918594249136 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1734918594249679 ] max_sm_queue_count = 5 ] 2024-12-23 Mon 01:49:54:249.973 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709371651840, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2024-12-23 Mon 01:49:54:249.981 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709371651840, Pid 1]: Processing scm::EvSandeshSend in state Idle 2024-12-23 Mon 01:49:54:250.104 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709371651840, Pid 1]: SANDESH: Send FAILED: 1734918594249906 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-458-1:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1734918501114821 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 48 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 50, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 9, _iter59->first = sent _iter59->second = 0, ] ] ] 2024-12-23 Mon 01:49:54:250.121 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709371651840, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2024-12-23 Mon 01:49:54:250.179 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x204cbf0 2024-12-23 Mon 01:49:54:250.502 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x2060460 2024-12-23 Mon 01:49:54:253.203 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: RAC_Connect status: 0 0x200d7b0 2024-12-23 Mon 01:49:54:253.229 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: Connected to REDIS... 2024-12-23 Mon 01:49:54:253.251 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.12 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2024-12-23 Mon 01:49:54:253.267 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: RAC_Connect status: 0 0x2025af0 2024-12-23 Mon 01:49:54:253.275 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: Connected to REDIS... 2024-12-23 Mon 01:49:54:253.288 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.12 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2024-12-23 Mon 01:49:54:253.302 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: RAC_Connect status: 0 0x2039380 2024-12-23 Mon 01:49:54:253.309 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: Connected to REDIS... 2024-12-23 Mon 01:49:54:253.334 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.12 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2024-12-23 Mon 01:49:54:254.804 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: RAC_Connect status: 0 0x204cbf0 2024-12-23 Mon 01:49:54:254.820 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: Connected to REDIS... 2024-12-23 Mon 01:49:54:254.834 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.12 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2024-12-23 Mon 01:49:54:254.844 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: RAC_Connect status: 0 0x2060460 2024-12-23 Mon 01:49:54:254.849 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: Connected to REDIS... 2024-12-23 Mon 01:49:54:254.857 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.12 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2024-12-23 Mon 01:49:54:260.325 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:56920 > SSL Handshake failed due to error: 335544539 category: asio.ssl message: short read src/contrail-common/io/ssl_server.cc 96 2024-12-23 Mon 01:49:54:260.359 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:56920 > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314 2024-12-23 Mon 01:49:54:263.250 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.12:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2024-12-23 Mon 01:49:54:263.279 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.12:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2024-12-23 Mon 01:49:54:263.295 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.12:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2024-12-23 Mon 01:49:54:263.304 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.12:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2024-12-23 Mon 01:49:54:263.317 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.12:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2024-12-23 Mon 01:49:54:263.326 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.12:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2024-12-23 Mon 01:49:54:263.344 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:40734 > SSL Handshake failed due to error: 335544539 category: asio.ssl message: short read src/contrail-common/io/ssl_server.cc 96 2024-12-23 Mon 01:49:54:263.360 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:40734 > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314 2024-12-23 Mon 01:49:54:265.453 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2024-12-23 Mon 01:49:54:265.489 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2024-12-23 Mon 01:49:54:265.502 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2024-12-23 Mon 01:49:54:265.529 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.12:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2024-12-23 Mon 01:49:54:265.539 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.12:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2024-12-23 Mon 01:49:54:265.557 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:49196 > SSL Handshake failed due to error: 335544539 category: asio.ssl message: short read src/contrail-common/io/ssl_server.cc 96 2024-12-23 Mon 01:49:54:265.578 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:49196 > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314 2024-12-23 Mon 01:49:54:265.690 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2024-12-23 Mon 01:49:54:265.705 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:59374 > SSL Handshake failed due to error: 335544539 category: asio.ssl message: short read src/contrail-common/io/ssl_server.cc 96 2024-12-23 Mon 01:49:54:265.717 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:59374 > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314 2024-12-23 Mon 01:49:54:265.747 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:41026 > SSL Handshake failed due to error: 335544539 category: asio.ssl message: short read src/contrail-common/io/ssl_server.cc 96 2024-12-23 Mon 01:49:54:265.870 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:41026 > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314 2024-12-23 Mon 01:49:54:265.926 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.12:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2024-12-23 Mon 01:49:54:265.937 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.12:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2024-12-23 Mon 01:49:54:265.951 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2024-12-23 Mon 01:49:54:265.502 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709338064640, Pid 1]: Processing scm::EvSandeshSend in state Idle 2024-12-23 Mon 01:49:54:266.231 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709338064640, Pid 1]: SANDESH: Send FAILED: 1734918594265409 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-458-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.12:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.12:6379, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Collector, Redis-Query:Query connection down ], ] ] ] 2024-12-23 Mon 01:49:54:266.243 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709338064640, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2024-12-23 Mon 01:49:54:266.256 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709338064640, Pid 1]: Processing scm::EvSandeshSend in state Idle 2024-12-23 Mon 01:49:54:266.331 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709338064640, Pid 1]: SANDESH: Send FAILED: 1734918594265482 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-458-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.12:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.12:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2024-12-23 Mon 01:49:54:266.361 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709338064640, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2024-12-23 Mon 01:49:55:251.000 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709375850240, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2024-12-23 Mon 01:49:55:251.239 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709375850240, Pid 1]: Connect : Start Connect timer 10.0.0.12:8086 2024-12-23 Mon 01:49:55:251.355 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709375850240, Pid 1]: Processing scm::EvSandeshSend in state Connect 2024-12-23 Mon 01:49:55:251.385 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709375850240, Pid 1]: SANDESH: Send FAILED: 1734918595251068 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-458-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.12:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.12:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.12:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2024-12-23 Mon 01:49:55:251.393 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709375850240, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2024-12-23 Mon 01:49:55:251.402 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709375850240, Pid 1]: Processing scm::EvSandeshSend in state Connect 2024-12-23 Mon 01:49:55:251.517 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709375850240, Pid 1]: SANDESH: Send FAILED: 1734918595251341 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-458-1:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1734918501114821 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 80, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 13, _iter59->first = sent _iter59->second = 0, ] ] ] 2024-12-23 Mon 01:49:55:251.536 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709375850240, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2024-12-23 Mon 01:49:55:258.917 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:56648::10.0.0.12:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2024-12-23 Mon 01:49:55:258.953 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: 10.0.0.12:56648::10.0.0.12:8086(-1) OnSessionEvent TCP Connected 2024-12-23 Mon 01:49:55:258.963 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: 10.0.0.12:56648::10.0.0.12:8086(-1):EvTcpConnected 2024-12-23 Mon 01:49:55:259.936 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709375850240, Pid 1]: Processing scm::EvTcpConnected in state Connect 2024-12-23 Mon 01:49:55:259.960 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709375850240, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2024-12-23 Mon 01:49:55:259.998 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709375850240, Pid 1]: ClientInit 2024-12-23 Mon 01:49:55:260.022 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709375850240, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-458-1:contrail-query-engine:0:Database count 1 2024-12-23 Mon 01:49:55:260.098 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709375850240, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2024-12-23 Mon 01:49:55:260.107 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709375850240, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2024-12-23 Mon 01:49:55:260.130 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709375850240, Pid 1]: SANDESH: Send FAILED: 1734918595259989 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-458-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.12:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.12:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.12:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2024-12-23 Mon 01:49:55:260.137 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709375850240, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2024-12-23 Mon 01:49:55:260.146 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709375850240, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2024-12-23 Mon 01:49:55:260.152 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709375850240, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2024-12-23 Mon 01:49:55:260.173 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709375850240, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2024-12-23 Mon 01:49:55:260.179 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709375850240, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2024-12-23 Mon 01:49:55:260.292 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709375850240, Pid 1]: SANDESH: Send FAILED: 1734918595260088 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-458-1:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1734918501114821 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 81, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 15, _iter59->first = sent _iter59->second = 0, ] ] ] 2024-12-23 Mon 01:49:55:260.306 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709375850240, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2024-12-23 Mon 01:49:55:261.720 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:56648::10.0.0.12:8086(-1) < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 01:49:55:262.138 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: 10.0.0.12:56648::10.0.0.12:8086(-1) OnSessionEvent TCP Connection Closed 2024-12-23 Mon 01:49:55:263.100 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: 10.0.0.12:56648::10.0.0.12:8086(-1):EvTcpClose 2024-12-23 Mon 01:49:55:263.190 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708701071104, Pid 1]: Processing scm::EvTcpClose in state ClientInit 2024-12-23 Mon 01:49:55:263.218 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708701071104, Pid 1]: ClientInit : EvTcpClose 2024-12-23 Mon 01:49:55:263.268 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708701071104, Pid 1]: Return to idle with 1000 2024-12-23 Mon 01:49:55:263.277 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708701071104, Pid 1]: Idle 2024-12-23 Mon 01:49:55:264.428 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708701071104, Pid 1]: Processing scm::EvSandeshSend in state Idle 2024-12-23 Mon 01:49:55:264.464 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708701071104, Pid 1]: SANDESH: Send FAILED: 1734918595263247 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-458-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.12:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.12:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.12:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2024-12-23 Mon 01:49:55:264.472 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708701071104, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2024-12-23 Mon 01:49:55:264.482 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708701071104, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2024-12-23 Mon 01:49:55:264.549 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708701071104, Pid 1]: Processing scm::EvSandeshSend in state Idle 2024-12-23 Mon 01:49:55:264.684 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708701071104, Pid 1]: SANDESH: Send FAILED: 1734918595264413 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-458-1:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 1 pid = 1 http_port = 8091 start_time = 1734918501114821 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 1563 calls = 1 average_bytes = 1563 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 82, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 17, _iter59->first = sent _iter59->second = 1, ] ] ] 2024-12-23 Mon 01:49:55:264.700 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708701071104, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2024-12-23 Mon 01:49:56:263.427 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708705269504, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2024-12-23 Mon 01:49:56:263.727 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708705269504, Pid 1]: Connect : Start Connect timer 10.0.0.12:8086 2024-12-23 Mon 01:49:56:263.890 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708705269504, Pid 1]: Processing scm::EvSandeshSend in state Connect 2024-12-23 Mon 01:49:56:263.924 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708705269504, Pid 1]: SANDESH: Send FAILED: 1734918596263511 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-458-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.12:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.12:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.12:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2024-12-23 Mon 01:49:56:263.944 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708705269504, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2024-12-23 Mon 01:49:56:263.958 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708705269504, Pid 1]: Processing scm::EvSandeshSend in state Connect 2024-12-23 Mon 01:49:56:264.145 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708705269504, Pid 1]: SANDESH: Send FAILED: 1734918596263872 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-458-1:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 1 pid = 1 http_port = 8091 start_time = 1734918501114821 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 1563 calls = 1 average_bytes = 1563 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 82, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 19, _iter59->first = sent _iter59->second = 1, ] ] ] 2024-12-23 Mon 01:49:56:264.162 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708705269504, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2024-12-23 Mon 01:49:56:271.560 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:56698::10.0.0.12:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2024-12-23 Mon 01:49:56:271.594 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: 10.0.0.12:56698::10.0.0.12:8086(-1) OnSessionEvent TCP Connected 2024-12-23 Mon 01:49:56:271.603 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: 10.0.0.12:56698::10.0.0.12:8086(-1):EvTcpConnected 2024-12-23 Mon 01:49:56:271.670 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708696872704, Pid 1]: Processing scm::EvTcpConnected in state Connect 2024-12-23 Mon 01:49:56:271.698 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708696872704, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2024-12-23 Mon 01:49:56:271.737 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708696872704, Pid 1]: ClientInit 2024-12-23 Mon 01:49:56:271.755 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708696872704, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-os-458-1:contrail-query-engine:0:Database count 2 2024-12-23 Mon 01:49:56:271.868 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708696872704, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2024-12-23 Mon 01:49:56:271.878 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708696872704, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2024-12-23 Mon 01:49:56:271.901 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708696872704, Pid 1]: SANDESH: Send FAILED: 1734918596271728 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-os-458-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.12:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.12:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.12:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2024-12-23 Mon 01:49:56:271.915 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708696872704, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2024-12-23 Mon 01:49:56:271.934 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708696872704, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2024-12-23 Mon 01:49:56:271.940 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708696872704, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2024-12-23 Mon 01:49:56:271.951 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708696872704, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2024-12-23 Mon 01:49:56:271.957 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708696872704, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2024-12-23 Mon 01:49:56:272.183 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708696872704, Pid 1]: SANDESH: Send FAILED: 1734918596271857 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-os-458-1:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 2 pid = 1 http_port = 8091 start_time = 1734918501114821 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 1563 calls = 1 average_bytes = 1563 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 83, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 21, _iter59->first = sent _iter59->second = 1, ] ] ] 2024-12-23 Mon 01:49:56:272.203 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708696872704, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2024-12-23 Mon 01:49:56:275.132 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709380048640, Pid 1]: OnMessage control in state: ClientInit 2024-12-23 Mon 01:49:56:275.215 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139707623130880, Pid 1]: Processing scm::EvSandeshMessageRecv in state ClientInit 2024-12-23 Mon 01:49:56:275.252 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139707623130880, Pid 1]: ClientInit : EvSandeshMessageRecv 2024-12-23 Mon 01:49:56:275.297 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139707623130880, Pid 1]: Received Ctrl Message with size 0 2024-12-23 Mon 01:49:56:275.684 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139707623130880, Pid 1]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-juju-os-458-1:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 2 pid = 1 http_port = 8091 start_time = 1734918501114821 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 1563 calls = 1 average_bytes = 1563 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 9 dequeues = 9 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 13 dequeues = 13 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1734918594249136 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1734918594249679 ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 68 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 83, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 21, _iter59->first = sent _iter59->second = 1, ] ] max_sm_queue_count = 5 proxy seq 12 2024-12-23 Mon 01:49:56:275.738 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139707623130880, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2024-12-23 Mon 01:49:56:275.803 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139707623130880, Pid 1]: SyncUVE Syncing ObjectDatabaseInfo val name = cn-jenkins-deploy-platform-juju-os-458-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.12:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.12:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.12:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] proxy seq 12 2024-12-23 Mon 01:49:56:275.821 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139707623130880, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2024-12-23 Mon 01:49:56:275.832 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139707623130880, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 without seqno , total = 0 2024-12-23 Mon 01:49:56:275.842 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139707623130880, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0 2024-12-23 Mon 01:49:56:275.898 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139707623130880, Pid 1]: Established 2024-12-23 Mon 01:50:01:216.784 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139707614734080, Pid 1]: OnMessage control in state: Established 2024-12-23 Mon 01:50:01:216.886 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139707614734080, Pid 1]: Processing scm::EvSandeshMessageRecv in state Established 2024-12-23 Mon 01:50:01:216.901 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139707614734080, Pid 1]: Established : EvSandeshMessageRecv 2024-12-23 Mon 01:50:01:216.967 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139707614734080, Pid 1]: Received Ctrl Message with size 3 2024-12-23 Mon 01:50:01:216.986 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139707614734080, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 with seqno 13, total = 0 2024-12-23 Mon 01:50:01:217.000 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139707614734080, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 with seqno 14, total = 0 2024-12-23 Mon 01:50:01:217.664 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139707614734080, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 with seqno 1, total = 0 2024-12-23 Mon 01:50:01:217.691 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139707614734080, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0 2024-12-23 Mon 01:50:09:338.385 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:37536 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 01:50:09:383.108 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:37536 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 01:50:16:670.284 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:44372 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 01:50:16:715.397 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:44372 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 01:50:24:250.982 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709346461440, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 1 without seqno , total = 0 2024-12-23 Mon 01:50:24:596.296 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:58842 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 01:50:24:644.436 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:58842 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 01:50:34:355.022 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:49266 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 01:50:34:399.227 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:49266 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 01:51:24:252.835 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709371651840, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 2 without seqno , total = 0 2024-12-23 Mon 01:52:24:253.537 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709380048640, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 3 without seqno , total = 0 2024-12-23 Mon 01:53:24:254.130 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709321271040, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 4 without seqno , total = 0 2024-12-23 Mon 01:54:11:818.586 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:48278 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 01:54:11:867.517 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:48278 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 01:54:17:724.351 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:37296 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 01:54:17:771.286 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:37296 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 01:54:24:254.842 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708680079104, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 5 without seqno , total = 0 2024-12-23 Mon 01:54:37:537.857 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:35542 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 01:54:37:583.216 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:35542 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 01:54:43:591.236 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:49408 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 01:54:43:635.530 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:49408 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 01:55:24:257.465 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708654896896, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 6 without seqno , total = 0 2024-12-23 Mon 01:56:24:258.082 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709359056640, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 7 without seqno , total = 0 2024-12-23 Mon 01:57:24:258.996 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709375850240, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 8 without seqno , total = 0 2024-12-23 Mon 01:58:24:260.007 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708680079104, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 9 without seqno , total = 0 2024-12-23 Mon 01:59:24:260.616 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709371651840, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 10 without seqno , total = 0 2024-12-23 Mon 01:59:28:123.294 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:58350 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 01:59:28:167.197 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:58350 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 01:59:33:099.971 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:42138 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 01:59:33:143.215 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:42138 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 01:59:47:865.749 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:59724 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 01:59:47:911.298 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:59724 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 02:00:16:118.620 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:34286 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 02:00:16:163.337 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:34286 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 02:00:24:261.173 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709380048640, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 11 without seqno , total = 0 2024-12-23 Mon 02:01:24:261.781 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708688475904, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 12 without seqno , total = 0 2024-12-23 Mon 02:02:24:262.421 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139707618932480, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 13 without seqno , total = 0 2024-12-23 Mon 02:03:24:263.266 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709380048640, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 14 without seqno , total = 0 2024-12-23 Mon 02:04:24:263.877 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709375850240, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 15 without seqno , total = 0 2024-12-23 Mon 02:04:29:646.147 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:33930 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 02:04:29:691.244 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:33930 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 02:04:43:867.908 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:45696 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 02:04:43:911.233 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:45696 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 02:04:49:243.036 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:45710 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 02:04:49:287.177 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:45710 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 02:05:24:264.779 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709329667840, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 16 without seqno , total = 0 2024-12-23 Mon 02:05:27:289.541 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:36976 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 02:05:27:339.178 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:36976 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 02:06:24:267.541 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708675880704, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 17 without seqno , total = 0 2024-12-23 Mon 02:07:24:268.865 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709338064640, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 18 without seqno , total = 0 2024-12-23 Mon 02:08:24:269.511 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709350659840, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 19 without seqno , total = 0 2024-12-23 Mon 02:09:24:270.158 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709375850240, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 20 without seqno , total = 0 2024-12-23 Mon 02:09:32:034.276 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:53492 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 02:09:32:079.786 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:53492 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 02:09:37:385.582 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:51956 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 02:09:37:427.380 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:51956 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 02:09:56:518.101 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:43178 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 02:09:56:563.322 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:43178 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 02:10:24:270.767 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709321271040, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 21 without seqno , total = 0 2024-12-23 Mon 02:11:09:038.316 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:41424 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 02:11:09:083.684 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:41424 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 02:11:24:271.786 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709325469440, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 22 without seqno , total = 0 2024-12-23 Mon 02:12:24:272.514 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708684277504, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 23 without seqno , total = 0 2024-12-23 Mon 02:13:24:273.671 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709363255040, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 24 without seqno , total = 0 2024-12-23 Mon 02:13:34:906.314 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:33794 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 02:13:34:951.360 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:33794 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 02:13:41:162.873 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:33804 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 02:13:41:207.205 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:33804 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 02:14:24:274.358 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709325469440, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 25 without seqno , total = 0 2024-12-23 Mon 02:14:50:771.847 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:34050 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 02:14:50:815.288 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:34050 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 02:15:24:275.043 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139707627329280, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 26 without seqno , total = 0 2024-12-23 Mon 02:16:24:276.579 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708675880704, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 27 without seqno , total = 0 2024-12-23 Mon 02:16:46:979.470 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:42740 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 02:16:47:023.185 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:42740 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 02:17:24:277.137 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708675880704, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 28 without seqno , total = 0 2024-12-23 Mon 02:17:38:653.797 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:57786 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 02:17:38:699.243 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:57786 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 02:17:44:403.333 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:33452 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 02:17:44:447.654 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:33452 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 02:18:24:277.787 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709325469440, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 29 without seqno , total = 0 2024-12-23 Mon 02:18:58:559.420 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:54938 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 02:18:58:603.317 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:54938 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 02:19:24:278.794 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708654896896, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 30 without seqno , total = 0 2024-12-23 Mon 02:20:24:279.388 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708684277504, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 31 without seqno , total = 0 2024-12-23 Mon 02:21:24:280.154 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709329667840, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 32 without seqno , total = 0 2024-12-23 Mon 02:22:24:280.789 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709325469440, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 33 without seqno , total = 0 2024-12-23 Mon 02:22:29:186.255 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:53356 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 02:22:29:235.353 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:53356 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 02:23:17:986.665 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:46666 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 02:23:18:031.449 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:46666 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 02:23:23:695.874 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:40048 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 02:23:23:743.249 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:40048 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 02:23:24:282.113 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139707623130880, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 34 without seqno , total = 0 2024-12-23 Mon 02:24:19:203.313 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:38242 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 02:24:19:251.498 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:38242 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 02:24:24:283.217 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708654896896, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 35 without seqno , total = 0 2024-12-23 Mon 02:25:24:284.230 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708654896896, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 36 without seqno , total = 0 2024-12-23 Mon 02:26:24:285.548 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139707623130880, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 37 without seqno , total = 0 2024-12-23 Mon 02:26:38:190.343 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:34506 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 02:26:38:235.752 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:34506 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 02:27:24:286.150 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709338064640, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 38 without seqno , total = 0 2024-12-23 Mon 02:28:24:287.006 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709363255040, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 39 without seqno , total = 0 2024-12-23 Mon 02:28:33:350.101 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:53094 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 02:28:33:395.138 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:53094 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 02:28:59:302.563 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:43558 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 02:28:59:347.225 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:43558 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 02:29:05:212.208 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:34620 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 02:29:05:255.441 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:34620 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504 2024-12-23 Mon 02:29:24:287.688 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139708701071104, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 40 without seqno , total = 0 2024-12-23 Mon 02:30:24:288.593 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139707623130880, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 41 without seqno , total = 0 2024-12-23 Mon 02:31:24:289.392 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709363255040, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 42 without seqno , total = 0 2024-12-23 Mon 02:31:55:078.107 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:53802 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2024-12-23 Mon 02:31:55:123.990 UTC cn-jenkins-deploy-platform-juju-os-458-1 [Thread 139709523515520, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8091::10.0.0.12:53802 < Read failed due to error asio.ssl 335544539 : short read src/contrail-common/io/tcp_session.cc 504