2025-05-26 Mon 00:45:58:474.785 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: http-server-port 8091 2025-05-26 Mon 00:45:58:478.198 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: Max-tasks 16 2025-05-26 Mon 00:45:58:478.225 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: Max-slice 100 2025-05-26 Mon 00:45:58:478.232 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: Collectors 10.0.0.19:8086 2025-05-26 Mon 00:45:58:478.237 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: Collectors 10.0.0.41:8086 2025-05-26 Mon 00:45:58:478.242 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: Collectors 10.0.0.61:8086 2025-05-26 Mon 00:45:58:478.263 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: SANDESH: ROLE : Generator 2025-05-26 Mon 00:45:58:478.270 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: SANDESH: MODULE : contrail-query-engine 2025-05-26 Mon 00:45:58:478.275 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: SANDESH: SOURCE : cn-jenkins-deploy-platform-ansible-os-3335-2. 2025-05-26 Mon 00:45:58:478.280 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: SANDESH: NODE TYPE : Database 2025-05-26 Mon 00:45:58:478.286 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: SANDESH: INSTANCE ID : 0 2025-05-26 Mon 00:45:58:478.291 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: SANDESH: HTTP SERVER PORT : 8091 2025-05-26 Mon 00:45:58:478.297 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: SANDESH: System Log Send Rate Limit: 0 -> 0 2025-05-26 Mon 00:45:58:478.897 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: HTTP Introspect Init 2025-05-26 Mon 00:45:58:479.009 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8091 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-05-26 Mon 00:45:58:479.067 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: Sandesh Http Server Port: 8091 2025-05-26 Mon 00:45:58:479.104 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: SANDESH: NOT Writing http_port 8091TO : /tmp/contrail-query-engine.0.http_port 2025-05-26 Mon 00:45:58:479.113 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: SANDESH: CONNECT TO COLLECTOR: 1 2025-05-26 Mon 00:45:58:479.200 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: Idle 2025-05-26 Mon 00:45:58:479.349 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: SANDESH: No Client: 1748220358479277 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3335-2.:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1748220358479210 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 0, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-05-26 Mon 00:45:58:479.475 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: SANDESH: Logging: DISABLED -> ENABLED 2025-05-26 Mon 00:45:58:479.489 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ] 2025-05-26 Mon 00:45:58:479.500 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: Cassandra Servers: 10.0.0.19:9042 10.0.0.41:9042 10.0.0.61:9042 2025-05-26 Mon 00:45:58:482.307 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042012067584, Pid 1]: Processing scm::EvStart in state Idle 2025-05-26 Mon 00:45:58:482.398 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042012067584, Pid 1]: Disconnect 2025-05-26 Mon 00:45:58:482.473 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042012067584, Pid 1]: Processing scm::EvCollectorUpdate in state Disconnect 2025-05-26 Mon 00:45:58:482.679 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042012067584, Pid 1]: Connect : Start Connect timer 10.0.0.19:8086 2025-05-26 Mon 00:45:58:482.748 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042012067584, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-05-26 Mon 00:45:58:482.768 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042012067584, Pid 1]: SANDESH: Send FAILED: 1748220358482388 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3335-2. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Idle : EvStart -> Disconnect ], ] ] flag_infos= [ [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ], ] ] ] 2025-05-26 Mon 00:45:58:482.777 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042012067584, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-05-26 Mon 00:45:58:482.785 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042012067584, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-05-26 Mon 00:45:58:482.863 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042012067584, Pid 1]: SANDESH: Send FAILED: 1748220358482462 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3335-2.:Database:contrail-query-engine:0 client_info= [ status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1748220358479210 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-05-26 Mon 00:45:58:482.880 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042012067584, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-05-26 Mon 00:45:58:482.890 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042012067584, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-05-26 Mon 00:45:58:482.980 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042012067584, Pid 1]: SANDESH: Send FAILED: 1748220358482521 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3335-2.:Database:contrail-query-engine:0 client_info= [ status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1748220358479210 collector_name = collector_ip = 10.0.0.19:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, (*_iter40) = 10.0.0.61:8086, (*_iter40) = 10.0.0.41:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-05-26 Mon 00:45:58:483.002 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042012067584, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-05-26 Mon 00:45:58:483.015 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042012067584, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-05-26 Mon 00:45:58:483.031 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042012067584, Pid 1]: SANDESH: Send FAILED: 1748220358482542 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3335-2. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.19:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], ] ] flag_infos= [ [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ], ] ] ] 2025-05-26 Mon 00:45:58:483.037 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042012067584, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-05-26 Mon 00:45:58:483.045 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042012067584, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-05-26 Mon 00:45:58:483.108 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042012067584, Pid 1]: SANDESH: Send FAILED: 1748220358482737 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3335-2.:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1748220358479210 collector_name = collector_ip = 10.0.0.19:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, (*_iter40) = 10.0.0.61:8086, (*_iter40) = 10.0.0.41:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-05-26 Mon 00:45:58:483.128 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042012067584, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-05-26 Mon 00:45:58:508.867 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-05-26 Mon 00:45:58:508.900 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-05-26 Mon 00:45:58:508.966 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 0 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-05-26 Mon 00:45:58:511.649 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041995273984, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-05-26 Mon 00:45:58:512.722 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041995273984, Pid 1]: SANDESH: Send FAILED: 1748220358508937 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3335-2. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.19:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.19:9042, (*_iter6) = 10.0.0.41:9042, (*_iter6) = 10.0.0.61:9042, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ], ] ] ] 2025-05-26 Mon 00:45:58:512.738 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041995273984, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-05-26 Mon 00:46:03:511.813 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-05-26 Mon 00:46:03:511.856 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-05-26 Mon 00:46:03:511.892 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 1 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-05-26 Mon 00:46:08:515.021 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-05-26 Mon 00:46:08:515.087 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-05-26 Mon 00:46:08:515.133 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 2 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-05-26 Mon 00:46:13:516.948 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-05-26 Mon 00:46:13:516.995 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-05-26 Mon 00:46:13:517.018 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 3 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-05-26 Mon 00:46:18:518.669 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-05-26 Mon 00:46:18:518.708 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-05-26 Mon 00:46:18:518.730 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 4 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-05-26 Mon 00:46:23:707.412 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004 2025-05-26 Mon 00:46:23:707.452 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-05-26 Mon 00:46:23:707.474 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 5 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-05-26 Mon 00:46:28:764.549 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004 2025-05-26 Mon 00:46:28:764.591 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-05-26 Mon 00:46:28:764.611 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 6 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-05-26 Mon 00:46:33:787.095 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-05-26 Mon 00:46:33:787.159 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 7 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-05-26 Mon 00:46:38:813.272 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: Older table does not exist. will query only the new table src/contrail-analytics/contrail-query-engine/query.cc 1037 2025-05-26 Mon 00:46:43:832.215 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-05-26 Mon 00:46:43:832.262 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: -(-1) OnSessionEvent TCP Connect Failed 2025-05-26 Mon 00:46:43:832.294 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: -(-1):EvTcpConnectFail 2025-05-26 Mon 00:46:43:832.313 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: RAC_Connect status: 0 0xd711a0 2025-05-26 Mon 00:46:43:832.325 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: Connected to REDIS... 2025-05-26 Mon 00:46:43:832.339 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.41 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-05-26 Mon 00:46:43:832.351 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: RAC_Connect status: 0 0xd71ae0 2025-05-26 Mon 00:46:43:832.357 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: Connected to REDIS... 2025-05-26 Mon 00:46:43:832.365 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.41 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-05-26 Mon 00:46:43:832.375 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: RAC_Connect status: 0 0xd72420 2025-05-26 Mon 00:46:43:832.380 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: Connected to REDIS... 2025-05-26 Mon 00:46:43:832.278 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: SANDESH: Send FAILED: 1748220403832126 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3335-2. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.19:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.19:9042, (*_iter6) = 10.0.0.41:9042, (*_iter6) = 10.0.0.61:9042, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ], ] ] ] 2025-05-26 Mon 00:46:43:832.405 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-05-26 Mon 00:46:43:832.421 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: Processing scm::EvTcpConnectFail in state Connect 2025-05-26 Mon 00:46:43:832.433 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: Connect : EvTcpConnectFail 2025-05-26 Mon 00:46:43:832.567 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-05-26 Mon 00:46:43:832.605 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: Idle 2025-05-26 Mon 00:46:43:832.669 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-05-26 Mon 00:46:43:832.777 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: SANDESH: Send FAILED: 1748220403832519 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3335-2.:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1748220358479210 collector_name = collector_ip = 10.0.0.61:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, (*_iter40) = 10.0.0.61:8086, (*_iter40) = 10.0.0.41:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 27 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 28, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-05-26 Mon 00:46:43:832.793 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-05-26 Mon 00:46:43:832.389 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.41 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-05-26 Mon 00:46:43:832.811 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-05-26 Mon 00:46:43:832.850 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: RAC_Connect status: 0 0xd72d60 2025-05-26 Mon 00:46:43:832.858 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: Connected to REDIS... 2025-05-26 Mon 00:46:43:832.863 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: SANDESH: Send FAILED: 1748220403832544 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3335-2. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.19:9042, (*_iter6) = 10.0.0.41:9042, (*_iter6) = 10.0.0.61:9042, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ], ] ] ] 2025-05-26 Mon 00:46:43:832.884 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.41 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-05-26 Mon 00:46:43:832.892 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-05-26 Mon 00:46:43:832.905 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-05-26 Mon 00:46:43:832.943 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-05-26 Mon 00:46:43:832.896 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: RAC_Connect status: 0 0xd6fca0 2025-05-26 Mon 00:46:43:833.041 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: SANDESH: Send FAILED: 1748220403832661 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3335-2.:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1748220358479210 collector_name = collector_ip = 10.0.0.61:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, (*_iter40) = 10.0.0.61:8086, (*_iter40) = 10.0.0.41:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 27 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 29, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-05-26 Mon 00:46:43:833.053 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: Connected to REDIS... 2025-05-26 Mon 00:46:43:833.074 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-05-26 Mon 00:46:43:833.094 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.19 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-05-26 Mon 00:46:43:833.109 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: RAC_Connect status: 0 0xd736a0 2025-05-26 Mon 00:46:43:833.140 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: Connected to REDIS... 2025-05-26 Mon 00:46:43:833.153 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.41 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-05-26 Mon 00:46:43:833.164 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: RAC_Connect status: 0 0xd691d0 2025-05-26 Mon 00:46:43:833.170 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: Connected to REDIS... 2025-05-26 Mon 00:46:43:833.178 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.19 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-05-26 Mon 00:46:43:833.188 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: RAC_Connect status: 0 0xd70870 2025-05-26 Mon 00:46:43:833.193 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: Connected to REDIS... 2025-05-26 Mon 00:46:43:833.201 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.19 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-05-26 Mon 00:46:43:833.210 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: RAC_Connect status: 0 0xd70340 2025-05-26 Mon 00:46:43:833.216 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: Connected to REDIS... 2025-05-26 Mon 00:46:43:833.224 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.19 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-05-26 Mon 00:46:43:833.233 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: RAC_Connect status: 0 0xd74920 2025-05-26 Mon 00:46:43:833.238 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: Connected to REDIS... 2025-05-26 Mon 00:46:43:833.246 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.61 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-05-26 Mon 00:46:43:833.255 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: RAC_Connect status: 0 0xd73fe0 2025-05-26 Mon 00:46:43:833.261 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: Connected to REDIS... 2025-05-26 Mon 00:46:43:833.268 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.61 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-05-26 Mon 00:46:43:833.278 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: RAC_Connect status: 0 0xd75260 2025-05-26 Mon 00:46:43:833.283 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: Connected to REDIS... 2025-05-26 Mon 00:46:43:833.291 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.61 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-05-26 Mon 00:46:43:833.301 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: RAC_Connect status: 0 0xd6f5f0 2025-05-26 Mon 00:46:43:833.306 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: Connected to REDIS... 2025-05-26 Mon 00:46:43:833.315 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.19 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-05-26 Mon 00:46:43:833.324 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: RAC_Connect status: 0 0xd75ba0 2025-05-26 Mon 00:46:43:833.333 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: Connected to REDIS... 2025-05-26 Mon 00:46:43:833.341 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.61 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-05-26 Mon 00:46:43:833.350 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: RAC_Connect status: 0 0xd764e0 2025-05-26 Mon 00:46:43:833.355 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: Connected to REDIS... 2025-05-26 Mon 00:46:43:833.363 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.61 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-05-26 Mon 00:46:43:833.477 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-05-26 Mon 00:46:43:833.524 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: SANDESH: Send FAILED: 1748220403833399 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3335-2.:Database:contrail-query-engine:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 14 dequeues = 14 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1748220403832604 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1748220403832942 ] max_sm_queue_count = 5 ] 2025-05-26 Mon 00:46:43:833.532 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-05-26 Mon 00:46:43:833.541 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-05-26 Mon 00:46:43:833.654 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: SANDESH: Send FAILED: 1748220403833463 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3335-2.:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1748220358479210 collector_name = collector_ip = 10.0.0.61:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, (*_iter40) = 10.0.0.61:8086, (*_iter40) = 10.0.0.41:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 39 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 41, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-05-26 Mon 00:46:43:833.670 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-05-26 Mon 00:46:43:834.269 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.19:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-05-26 Mon 00:46:43:834.295 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.19:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-05-26 Mon 00:46:43:834.317 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.19:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-05-26 Mon 00:46:43:834.334 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.19:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-05-26 Mon 00:46:43:834.348 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.19:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-05-26 Mon 00:46:43:834.357 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.19:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-05-26 Mon 00:46:43:834.372 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.19:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-05-26 Mon 00:46:43:834.381 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.19:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-05-26 Mon 00:46:43:834.394 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.19:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-05-26 Mon 00:46:43:834.404 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.19:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-05-26 Mon 00:46:43:834.462 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-05-26 Mon 00:46:43:834.487 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042007869184, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-05-26 Mon 00:46:43:834.535 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042007869184, Pid 1]: SANDESH: Send FAILED: 1748220403834437 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3335-2. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.19:9042, (*_iter6) = 10.0.0.41:9042, (*_iter6) = 10.0.0.61:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.19:6379, (*_iter6) = 10.0.0.41:6379, (*_iter6) = 10.0.0.61:6379, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Collector, Redis-Query:Query connection down ], ] ] ] 2025-05-26 Mon 00:46:43:834.571 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042007869184, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-05-26 Mon 00:46:43:834.602 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042007869184, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-05-26 Mon 00:46:43:834.625 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042007869184, Pid 1]: SANDESH: Send FAILED: 1748220403834486 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3335-2. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.19:9042, (*_iter6) = 10.0.0.41:9042, (*_iter6) = 10.0.0.61:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.19:6379, (*_iter6) = 10.0.0.41:6379, (*_iter6) = 10.0.0.61:6379, ] ] status = Up description = 10.0.0.41:6379::Down.10.0.0.61:6379::Down. ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-05-26 Mon 00:46:43:834.637 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042007869184, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-05-26 Mon 00:46:43:834.492 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-05-26 Mon 00:46:43:845.592 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-05-26 Mon 00:46:43:845.613 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-05-26 Mon 00:46:43:845.630 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-05-26 Mon 00:46:43:845.693 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.61:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-05-26 Mon 00:46:43:845.705 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.61:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-05-26 Mon 00:46:43:845.719 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.61:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-05-26 Mon 00:46:43:845.729 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.61:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-05-26 Mon 00:46:43:845.742 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.61:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-05-26 Mon 00:46:43:845.752 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.61:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-05-26 Mon 00:46:43:845.765 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.61:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-05-26 Mon 00:46:43:845.774 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.61:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-05-26 Mon 00:46:43:845.787 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.61:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-05-26 Mon 00:46:43:845.797 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.61:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-05-26 Mon 00:46:43:845.811 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.41:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-05-26 Mon 00:46:43:845.821 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.41:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-05-26 Mon 00:46:43:845.841 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.41:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-05-26 Mon 00:46:43:845.850 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.41:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-05-26 Mon 00:46:43:845.863 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.41:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-05-26 Mon 00:46:43:845.872 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.41:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-05-26 Mon 00:46:43:845.885 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.41:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-05-26 Mon 00:46:43:845.894 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.41:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-05-26 Mon 00:46:43:845.907 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.41:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-05-26 Mon 00:46:43:845.916 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.41:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-05-26 Mon 00:46:43:845.935 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-05-26 Mon 00:46:43:845.981 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-05-26 Mon 00:46:43:845.999 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-05-26 Mon 00:46:43:846.014 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-05-26 Mon 00:46:43:846.029 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-05-26 Mon 00:46:43:846.049 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-05-26 Mon 00:46:43:846.072 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-05-26 Mon 00:46:43:846.086 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-05-26 Mon 00:46:43:846.098 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-05-26 Mon 00:46:43:846.114 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-05-26 Mon 00:46:43:852.830 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041561036544, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-05-26 Mon 00:46:43:852.893 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041561036544, Pid 1]: SANDESH: Send FAILED: 1748220403845960 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3335-2. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.19:9042, (*_iter6) = 10.0.0.41:9042, (*_iter6) = 10.0.0.61:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.19:6379, (*_iter6) = 10.0.0.41:6379, (*_iter6) = 10.0.0.61:6379, ] ] status = Up description = 10.0.0.41:6379::Down. ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-05-26 Mon 00:46:43:852.903 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041561036544, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-05-26 Mon 00:46:43:852.916 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041561036544, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-05-26 Mon 00:46:43:852.937 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041561036544, Pid 1]: SANDESH: Send FAILED: 1748220403846066 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3335-2. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.19:9042, (*_iter6) = 10.0.0.41:9042, (*_iter6) = 10.0.0.61:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.19:6379, (*_iter6) = 10.0.0.41:6379, (*_iter6) = 10.0.0.61:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-05-26 Mon 00:46:43:852.945 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041561036544, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-05-26 Mon 00:46:44:833.010 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041995273984, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-05-26 Mon 00:46:44:833.236 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041995273984, Pid 1]: Connect : Start Connect timer 10.0.0.61:8086 2025-05-26 Mon 00:46:44:833.341 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041995273984, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-05-26 Mon 00:46:44:833.369 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041995273984, Pid 1]: SANDESH: Send FAILED: 1748220404833085 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3335-2. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.61:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.19:9042, (*_iter6) = 10.0.0.41:9042, (*_iter6) = 10.0.0.61:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.19:6379, (*_iter6) = 10.0.0.41:6379, (*_iter6) = 10.0.0.61:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-05-26 Mon 00:46:44:833.385 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041995273984, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-05-26 Mon 00:46:44:833.394 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041995273984, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-05-26 Mon 00:46:44:833.508 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041995273984, Pid 1]: SANDESH: Send FAILED: 1748220404833328 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3335-2.:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1748220358479210 collector_name = collector_ip = 10.0.0.61:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, (*_iter40) = 10.0.0.61:8086, (*_iter40) = 10.0.0.41:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 86, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 16, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-05-26 Mon 00:46:44:833.523 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041995273984, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-05-26 Mon 00:46:44:836.598 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.41:53586::10.0.0.61:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280 2025-05-26 Mon 00:46:44:836.629 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: 10.0.0.41:53586::10.0.0.61:8086(-1) OnSessionEvent TCP Connected 2025-05-26 Mon 00:46:44:836.637 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: 10.0.0.41:53586::10.0.0.61:8086(-1):EvTcpConnected 2025-05-26 Mon 00:46:44:836.689 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-05-26 Mon 00:46:44:836.709 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-05-26 Mon 00:46:44:836.741 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: ClientInit 2025-05-26 Mon 00:46:44:836.768 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-3335-2.:contrail-query-engine:0:Database count 1 2025-05-26 Mon 00:46:44:836.841 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-05-26 Mon 00:46:44:836.850 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-05-26 Mon 00:46:44:836.872 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: SANDESH: Send FAILED: 1748220404836735 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3335-2. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.61:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.19:9042, (*_iter6) = 10.0.0.41:9042, (*_iter6) = 10.0.0.61:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.19:6379, (*_iter6) = 10.0.0.41:6379, (*_iter6) = 10.0.0.61:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-05-26 Mon 00:46:44:836.880 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-05-26 Mon 00:46:44:836.888 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-05-26 Mon 00:46:44:836.901 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-05-26 Mon 00:46:44:836.912 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-05-26 Mon 00:46:44:836.918 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-05-26 Mon 00:46:44:837.017 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: SANDESH: Send FAILED: 1748220404836831 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3335-2.:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1748220358479210 collector_name = collector_ip = 10.0.0.61:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, (*_iter40) = 10.0.0.61:8086, (*_iter40) = 10.0.0.41:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 87, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-05-26 Mon 00:46:44:837.031 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-05-26 Mon 00:46:44:838.541 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041527461632, Pid 1]: OnMessage control in state: ClientInit 2025-05-26 Mon 00:46:44:841.797 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041527461632, Pid 1]: Processing scm::EvSandeshMessageRecv in state ClientInit 2025-05-26 Mon 00:46:44:842.070 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041527461632, Pid 1]: ClientInit : EvSandeshMessageRecv 2025-05-26 Mon 00:46:44:842.098 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041527461632, Pid 1]: Received Ctrl Message with size 0 2025-05-26 Mon 00:46:44:842.253 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041527461632, Pid 1]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-3335-2.:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1748220358479210 collector_name = collector_ip = 10.0.0.61:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, (*_iter40) = 10.0.0.61:8086, (*_iter40) = 10.0.0.41:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 14 dequeues = 14 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1748220403832604 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1748220403832942 ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 87, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18, _iter59->first = sent _iter59->second = 0, ] ] max_sm_queue_count = 5 proxy seq 10 2025-05-26 Mon 00:46:44:842.280 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041527461632, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2025-05-26 Mon 00:46:44:842.304 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041527461632, Pid 1]: SyncUVE Syncing ObjectDatabaseInfo val name = cn-jenkins-deploy-platform-ansible-os-3335-2. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.61:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.19:9042, (*_iter6) = 10.0.0.41:9042, (*_iter6) = 10.0.0.61:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.19:6379, (*_iter6) = 10.0.0.41:6379, (*_iter6) = 10.0.0.61:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] proxy seq 11 2025-05-26 Mon 00:46:44:842.318 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041527461632, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2025-05-26 Mon 00:46:44:842.326 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041527461632, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 without seqno , total = 0 2025-05-26 Mon 00:46:44:842.334 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041527461632, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0 2025-05-26 Mon 00:46:44:842.363 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041527461632, Pid 1]: Established 2025-05-26 Mon 00:46:51:220.928 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041978480384, Pid 1]: OnMessage control in state: Established 2025-05-26 Mon 00:46:51:220.989 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041978480384, Pid 1]: Processing scm::EvSandeshMessageRecv in state Established 2025-05-26 Mon 00:46:51:221.000 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041978480384, Pid 1]: Established : EvSandeshMessageRecv 2025-05-26 Mon 00:46:51:221.060 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041978480384, Pid 1]: Received Ctrl Message with size 3 2025-05-26 Mon 00:46:51:221.075 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041978480384, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 with seqno 11, total = 0 2025-05-26 Mon 00:46:51:221.086 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041978480384, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 with seqno 13, total = 0 2025-05-26 Mon 00:46:51:221.098 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041978480384, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 with seqno 1, total = 0 2025-05-26 Mon 00:46:51:221.106 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041978480384, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0 2025-05-26 Mon 00:47:13:833.883 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041569433344, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 1 without seqno , total = 0 2025-05-26 Mon 00:48:13:835.843 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041569433344, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 2 without seqno , total = 0 2025-05-26 Mon 00:49:13:836.681 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041519064832, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 3 without seqno , total = 0 2025-05-26 Mon 00:49:21:157.404 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.41:8091::10.0.0.41:57116 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-05-26 Mon 00:49:39:669.504 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.41:8091::10.0.0.41:59526 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-05-26 Mon 00:50:13:837.226 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041995273984, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 4 without seqno , total = 0 2025-05-26 Mon 00:51:13:837.732 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 5 without seqno , total = 0 2025-05-26 Mon 00:52:13:838.198 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 6 without seqno , total = 0 2025-05-26 Mon 00:53:13:838.652 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 7 without seqno , total = 0 2025-05-26 Mon 00:54:13:839.143 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041531660032, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 8 without seqno , total = 0 2025-05-26 Mon 00:55:13:839.867 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041527461632, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 9 without seqno , total = 0 2025-05-26 Mon 00:56:13:840.381 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041991075584, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 10 without seqno , total = 0 2025-05-26 Mon 00:57:13:842.899 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041991075584, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 11 without seqno , total = 0 2025-05-26 Mon 00:58:13:843.389 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041523263232, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 12 without seqno , total = 0 2025-05-26 Mon 00:59:13:844.519 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041991075584, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 13 without seqno , total = 0 2025-05-26 Mon 01:00:13:844.970 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041995273984, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 14 without seqno , total = 0 2025-05-26 Mon 01:01:13:845.882 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041531660032, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 15 without seqno , total = 0 2025-05-26 Mon 01:02:13:847.523 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041531660032, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 16 without seqno , total = 0 2025-05-26 Mon 01:03:13:848.234 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 17 without seqno , total = 0 2025-05-26 Mon 01:04:13:848.685 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 18 without seqno , total = 0 2025-05-26 Mon 01:05:13:849.557 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 19 without seqno , total = 0 2025-05-26 Mon 01:06:13:850.352 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041527461632, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 20 without seqno , total = 0 2025-05-26 Mon 01:07:13:850.853 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041531660032, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 21 without seqno , total = 0 2025-05-26 Mon 01:08:13:851.427 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041561036544, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 22 without seqno , total = 0 2025-05-26 Mon 01:09:13:852.847 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 23 without seqno , total = 0 2025-05-26 Mon 01:10:13:853.960 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041991075584, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 24 without seqno , total = 0 2025-05-26 Mon 01:11:13:854.601 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041519064832, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 25 without seqno , total = 0 2025-05-26 Mon 01:12:13:855.072 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041569433344, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 26 without seqno , total = 0 2025-05-26 Mon 01:13:13:855.544 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041991075584, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 27 without seqno , total = 0 2025-05-26 Mon 01:14:13:856.317 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041991075584, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 28 without seqno , total = 0 2025-05-26 Mon 01:15:13:857.165 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041569433344, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 29 without seqno , total = 0 2025-05-26 Mon 01:16:13:857.685 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041527461632, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 30 without seqno , total = 0 2025-05-26 Mon 01:17:13:858.162 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041531660032, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 31 without seqno , total = 0 2025-05-26 Mon 01:18:13:858.649 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041982678784, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 32 without seqno , total = 0 2025-05-26 Mon 01:19:13:859.125 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 33 without seqno , total = 0 2025-05-26 Mon 01:20:13:859.681 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041527461632, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 34 without seqno , total = 0 2025-05-26 Mon 01:21:13:860.652 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041527461632, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 35 without seqno , total = 0 2025-05-26 Mon 01:22:13:861.132 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041982678784, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 36 without seqno , total = 0 2025-05-26 Mon 01:23:13:861.604 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041569433344, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 37 without seqno , total = 0 2025-05-26 Mon 01:24:13:862.181 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041991075584, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 38 without seqno , total = 0 2025-05-26 Mon 01:25:13:862.692 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041519064832, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 39 without seqno , total = 0 2025-05-26 Mon 01:26:13:863.289 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041569433344, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 40 without seqno , total = 0 2025-05-26 Mon 01:27:13:863.817 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041986877184, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 41 without seqno , total = 0 2025-05-26 Mon 01:28:13:865.027 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041569433344, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 42 without seqno , total = 0 2025-05-26 Mon 01:29:13:865.567 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041527461632, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 43 without seqno , total = 0 2025-05-26 Mon 01:30:13:866.181 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041527461632, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 44 without seqno , total = 0 2025-05-26 Mon 01:31:13:866.651 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041982678784, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 45 without seqno , total = 0 2025-05-26 Mon 01:32:13:867.150 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041519064832, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 46 without seqno , total = 0 2025-05-26 Mon 01:33:13:867.709 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041986877184, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 47 without seqno , total = 0 2025-05-26 Mon 01:34:13:868.191 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041986877184, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 48 without seqno , total = 0 2025-05-26 Mon 01:35:13:868.687 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042012067584, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 49 without seqno , total = 0 2025-05-26 Mon 01:36:13:869.419 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041991075584, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 50 without seqno , total = 0 2025-05-26 Mon 01:37:13:869.891 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041986877184, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 51 without seqno , total = 0 2025-05-26 Mon 01:38:13:870.374 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041519064832, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 52 without seqno , total = 0 2025-05-26 Mon 01:39:13:870.855 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041565234944, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 53 without seqno , total = 0 2025-05-26 Mon 01:40:13:871.331 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041519064832, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 54 without seqno , total = 0 2025-05-26 Mon 01:41:13:871.793 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041569433344, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 55 without seqno , total = 0 2025-05-26 Mon 01:42:13:872.275 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041986877184, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 56 without seqno , total = 0 2025-05-26 Mon 01:43:13:872.715 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041531660032, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 57 without seqno , total = 0 2025-05-26 Mon 01:44:13:873.229 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041531660032, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 58 without seqno , total = 0 2025-05-26 Mon 01:45:13:873.689 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041527461632, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 59 without seqno , total = 0 2025-05-26 Mon 01:46:13:874.138 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041569433344, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 60 without seqno , total = 0 2025-05-26 Mon 01:47:13:874.563 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041999472384, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 61 without seqno , total = 0 2025-05-26 Mon 01:48:13:875.044 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041519064832, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 62 without seqno , total = 0 2025-05-26 Mon 01:49:13:875.544 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042003670784, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 63 without seqno , total = 0 2025-05-26 Mon 01:50:13:876.097 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041986877184, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 64 without seqno , total = 0 2025-05-26 Mon 01:51:13:876.646 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041569433344, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 65 without seqno , total = 0 2025-05-26 Mon 01:52:13:877.087 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041982678784, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 66 without seqno , total = 0 2025-05-26 Mon 01:53:13:877.581 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140041523263232, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 67 without seqno , total = 0 2025-05-26 Mon 01:53:17:156.143 UTC cn-jenkins-deploy-platform-ansible-os-3335-2 [Thread 140042155739264, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.41:8091::10.0.0.41:37284 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254