09/14/2026 02:30:24.656 7fa9d6274540 [contrail-analytics-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 09/14/2026 02:30:24.656 7fa9d6274540 [contrail-analytics-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 09/14/2026 02:30:24.656 7fa9d6274540 [contrail-analytics-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 09/14/2026 02:30:24.656 7fa9d6274540 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/14/2026 02:30:24.718 7fa9d6274540 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 09/14/2026 02:30:24.720 7fa9d278c7c0 [contrail-analytics-api] [ERROR]: Cannot write http_port 8090 to /tmp/contrail-analytics-api.0.http_port 09/14/2026 02:30:24.720 7fa9d278c7c0 [contrail-analytics-api] [ERROR]: Starting Introspect on HTTP Port 8090 09/14/2026 02:30:24.720 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Processing event[EvStart] in state[none] 09/14/2026 02:30:24.721 7fa9d2ff9f40 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/14/2026 02:30:24.721 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 09/14/2026 02:30:24.722 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.722 7fa9d2ff9f40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, ] description = >>, ] >> 09/14/2026 02:30:24.722 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.722 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.722 7fa9d2ff9f40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Initializing description = Redis Instance initialized >>, ] description = Redis-UVE:10.0.0.38:6379[Redis Instance initialized] connection down >>, ] >> 09/14/2026 02:30:24.722 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.722 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.722 7fa9d2ff9f40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Initializing description = Redis Instance initialized >>, ] description = Redis-UVE:10.0.0.38:6379[Redis Instance initialized], Redis-UVE:10.0.0.189:6379[Redis Instance initialized] connection down >>, ] >> 09/14/2026 02:30:24.722 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.722 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.723 7fa9d2ff9f40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Initializing description = Redis Instance initialized >>, ] description = Redis-UVE:10.0.0.38:6379[Redis Instance initialized], Redis-UVE:10.0.0.189:6379[Redis Instance initialized], Redis-UVE:10.0.0.50:6379[Redis Instance initialized] connection down >>, ] >> 09/14/2026 02:30:24.723 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.723 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.723 7fa9d2ff9f40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, ] description = Redis-UVE:10.0.0.38:6379[Redis Instance initialized], Redis-UVE:10.0.0.189:6379[Redis Instance initialized], Redis-UVE:10.0.0.50:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized] connection down >>, ] >> 09/14/2026 02:30:24.723 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.723 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.723 7fa9d2ff9f40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] AnalyticsApiInfoUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. analytics_node_ip = { rest_api_ip : 10.0.0.50host_ip : 10.0.0.50 } >> 09/14/2026 02:30:24.723 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.724 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.724 7fa9d2ff9f40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Redis-UVE:10.0.0.38:6379[Redis Instance initialized], Redis-UVE:10.0.0.189:6379[Redis Instance initialized], Redis-UVE:10.0.0.50:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/14/2026 02:30:24.724 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.724 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.724 7fa9d2ff9f40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 7 max_sm_queue_count = 7 >> 09/14/2026 02:30:24.724 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.725 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:30:24.734 7fa9d2855c20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.734 7fa9d2855c20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Redis-UVE:10.0.0.38:6379[Redis Instance initialized], Redis-UVE:10.0.0.189:6379[Redis Instance initialized], Redis-UVE:10.0.0.50:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 09/14/2026 02:30:24.734 7fa9d2855c20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.741 7fa9d30e2c20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.741 7fa9d30e2c20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Redis-UVE:10.0.0.189:6379[Redis Instance initialized], Redis-UVE:10.0.0.50:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 09/14/2026 02:30:24.741 7fa9d30e2c20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.744 7fa9d30e2c20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.744 7fa9d30e2c20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Redis-UVE:10.0.0.189:6379[Redis Instance initialized], Redis-UVE:10.0.0.50:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:30:24.744 7fa9d30e2c20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.746 7fa9d30e2c20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.746 7fa9d30e2c20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Redis-UVE:10.0.0.50:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:30:24.746 7fa9d30e2c20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.747 7fa9d30e2c20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.748 7fa9d30e2c20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:30:24.748 7fa9d30e2c20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:28.721 7fa9d2838900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:30:28.723 7fa9d2838900 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:30:28.723 7fa9d2838900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:30:28.723 7fa9d2838900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:30:28.723 7fa9d2838900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:30:28.723 7fa9d2838900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:30:28.723 7fa9d2838900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:30:28.724 7fa9d2838900 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:30:28.724 7fa9d2838900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:30:28.724 7fa9d2838900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:30:28.724 7fa9d2838900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:30:28.724 7fa9d31f75e0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:30:28.726 7fa9d31f75e0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:30:39.768 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:30:40.770 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:30:56.854 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:30:58.723 7fa9d36507c0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:30:58.723 7fa9d36507c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:30:58.724 7fa9d36507c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:30:58.724 7fa9d36507c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:30:58.724 7fa9d36507c0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:30:58.724 7fa9d36507c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:58.724 7fa9d36507c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:30:58.724 7fa9d36507c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:58.724 7fa9d36507c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:58.724 7fa9d36507c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:30:58.724 7fa9d36507c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:31:02.724 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:31:02.725 7fa9d2b90400 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:31:02.725 7fa9d2b90400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:31:02.725 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:31:02.725 7fa9d2b90400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:31:02.726 7fa9d2b90400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:31:02.726 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:31:02.726 7fa9d2b90400 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:31:02.726 7fa9d2b90400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:31:02.726 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:31:02.726 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:31:02.726 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:31:02.727 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:31:12.875 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:31:28.915 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:31:32.725 7fa9d2838400 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:31:32.725 7fa9d2838400 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:31:32.726 7fa9d2838400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:31:32.726 7fa9d2838400 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:31:32.726 7fa9d2838400 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:31:32.726 7fa9d2838400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:31:32.726 7fa9d2838400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:31:32.726 7fa9d2838400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:31:32.726 7fa9d2838400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:31:32.726 7fa9d2838400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 2 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:31:32.726 7fa9d2838400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:31:36.726 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:31:36.727 7fa9d30e2720 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:31:36.727 7fa9d30e2720 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:31:36.728 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:31:36.728 7fa9d30e2720 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:31:36.728 7fa9d30e2720 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:31:36.728 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:31:36.728 7fa9d30e2720 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:31:36.728 7fa9d30e2720 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:31:36.728 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:31:36.728 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:31:36.729 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:31:36.729 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:31:44.927 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:32:01.014 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:32:06.727 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:32:06.727 7fa9d2abd5e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:32:06.728 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:32:06.728 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:32:06.728 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:32:06.728 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:06.729 7fa9d2abd5e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:32:06.729 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:06.729 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:06.729 7fa9d2abd5e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 3 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:32:06.729 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:10.728 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:32:10.730 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:32:10.730 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:32:10.730 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:32:10.730 7fa9d2abd5e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:32:10.730 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:32:10.730 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:32:10.730 7fa9d2abd5e0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:32:10.731 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:32:10.731 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:32:10.731 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:32:10.731 7fa9d363aa40 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:32:10.732 7fa9d363aa40 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:32:17.062 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:32:33.092 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:32:40.730 7fa9d28382c0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:32:40.731 7fa9d28382c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:32:40.731 7fa9d28382c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:32:40.731 7fa9d28382c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:32:40.731 7fa9d28382c0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:32:40.731 7fa9d28382c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:40.731 7fa9d28382c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:32:40.731 7fa9d28382c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:40.732 7fa9d28382c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:40.732 7fa9d28382c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:32:40.732 7fa9d28382c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:44.731 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:32:44.733 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:32:44.733 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:32:44.733 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:32:44.733 7fa9d2ff9f40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:32:44.733 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:32:44.733 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:32:44.733 7fa9d2ff9f40 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:32:44.734 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:32:44.734 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:32:44.734 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:32:44.734 7fa9d2838400 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:32:44.735 7fa9d2838400 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:32:49.172 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:33:05.233 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:33:14.732 7fa9d2838400 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:33:14.733 7fa9d2838400 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:33:14.733 7fa9d2838400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:33:14.733 7fa9d2838400 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:33:14.733 7fa9d2838400 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:33:14.733 7fa9d2838400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:33:14.734 7fa9d2838400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:33:14.734 7fa9d2838400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:33:14.734 7fa9d2838400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:33:14.734 7fa9d2838400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:33:14.734 7fa9d2838400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:33:18.733 7fa9d2838400 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:33:18.735 7fa9d2838400 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:33:18.735 7fa9d2838400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:33:18.735 7fa9d2838400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:33:18.735 7fa9d2838400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:33:18.735 7fa9d2838400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:33:18.736 7fa9d2838400 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:33:18.736 7fa9d2838400 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:33:18.736 7fa9d2838400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:33:18.736 7fa9d2838400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:33:18.736 7fa9d2838400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:33:18.736 7fa9d363aa40 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:33:18.737 7fa9d363aa40 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:33:21.320 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:33:37.329 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:33:48.735 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:33:48.735 7fa9d30e27c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:33:48.736 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:33:48.736 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:33:48.736 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:33:48.736 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:33:48.736 7fa9d30e27c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:33:48.736 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:33:48.736 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:33:48.736 7fa9d30e27c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 6 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:33:48.737 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:33:52.736 7fa9d300ed60 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:33:52.739 7fa9d300ed60 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:33:52.739 7fa9d300ed60 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:33:52.739 7fa9d300ed60 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:33:52.740 7fa9d300ed60 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:33:52.740 7fa9d300ed60 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:33:52.740 7fa9d300ed60 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:33:52.740 7fa9d300ed60 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:33:52.740 7fa9d300ed60 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:33:52.740 7fa9d300ed60 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:33:52.740 7fa9d300ed60 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:33:52.741 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:33:52.741 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:33:53.394 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:34:09.422 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:34:22.737 7fa9d31f7540 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:34:22.738 7fa9d31f7540 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:34:22.738 7fa9d31f7540 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:34:22.738 7fa9d31f7540 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:34:22.738 7fa9d31f7540 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:34:22.738 7fa9d31f7540 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:22.738 7fa9d31f7540 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:34:22.738 7fa9d31f7540 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:22.738 7fa9d31f7540 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:22.739 7fa9d31f7540 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 7 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:34:22.739 7fa9d31f7540 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:25.446 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:34:26.738 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:34:26.740 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:34:26.740 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:34:26.740 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:34:26.740 7fa9d31f72c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:34:26.740 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:34:26.740 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:34:26.740 7fa9d31f72c0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:34:26.741 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:34:26.741 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:34:26.741 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:34:26.741 7fa9d31f7a40 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:34:26.742 7fa9d31f7a40 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:34:41.544 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:34:56.740 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:34:56.740 7fa9d2b90400 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:34:56.741 7fa9d2b90400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:34:56.741 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:34:56.741 7fa9d2b90400 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:34:56.741 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:56.741 7fa9d2b90400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:34:56.741 7fa9d2b90400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:56.741 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:56.741 7fa9d2b90400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 8 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:34:56.741 7fa9d2b90400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:57.559 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:35:00.742 7fa9d2838400 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:35:00.743 7fa9d2838400 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:35:00.743 7fa9d2838400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:35:00.743 7fa9d2838400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:35:00.743 7fa9d2838400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:35:00.744 7fa9d2838400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:35:00.744 7fa9d2838400 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:35:00.744 7fa9d2838400 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:35:00.744 7fa9d2838400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:35:00.744 7fa9d2838400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:35:00.744 7fa9d2838400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:35:00.744 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:35:00.745 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:35:13.642 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:35:29.721 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:35:30.744 7fa9d31f75e0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:35:30.744 7fa9d31f75e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:35:30.744 7fa9d31f75e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:35:30.744 7fa9d31f75e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:35:30.744 7fa9d31f75e0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:35:30.745 7fa9d31f75e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:35:30.745 7fa9d31f75e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:35:30.745 7fa9d31f75e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:35:30.745 7fa9d31f75e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:35:30.745 7fa9d31f75e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 9 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:35:30.745 7fa9d31f75e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:35:34.745 7fa9d2838c20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:35:34.746 7fa9d2838c20 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:35:34.746 7fa9d2838c20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:35:34.746 7fa9d2838c20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:35:34.746 7fa9d2838c20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:35:34.746 7fa9d2838c20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:35:34.746 7fa9d2838c20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:35:34.747 7fa9d2838c20 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:35:34.747 7fa9d2838c20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:35:34.748 7fa9d2838c20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:35:34.748 7fa9d2838c20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:35:34.748 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:35:34.748 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:35:45.772 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:36:01.850 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:36:04.747 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:36:04.747 7fa9d30e27c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:36:04.747 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:36:04.747 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:36:04.747 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:36:04.747 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:36:04.748 7fa9d30e27c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:36:04.748 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:36:04.748 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:36:04.748 7fa9d30e27c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 10 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:36:04.748 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:36:08.748 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:36:08.749 7fa9d30e2720 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:36:08.749 7fa9d30e2720 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:36:08.749 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:36:08.749 7fa9d30e2720 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:36:08.749 7fa9d30e2720 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:36:08.749 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:36:08.750 7fa9d30e2720 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:36:08.750 7fa9d30e2720 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:36:08.750 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:36:08.750 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:36:08.750 7fa9d28382c0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:36:08.751 7fa9d28382c0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:36:17.949 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:36:33.967 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:36:38.749 7fa9d28387c0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:36:38.749 7fa9d28387c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:36:38.749 7fa9d28387c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:36:38.749 7fa9d28387c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:36:38.749 7fa9d28387c0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:36:38.749 7fa9d28387c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:36:38.750 7fa9d28387c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:36:38.750 7fa9d28387c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:36:38.750 7fa9d28387c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:36:38.750 7fa9d28387c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 11 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:36:38.750 7fa9d28387c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:36:42.750 7fa9d28387c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:36:42.752 7fa9d28387c0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:36:42.752 7fa9d28387c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:36:42.752 7fa9d28387c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:36:42.752 7fa9d28387c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:36:42.752 7fa9d28387c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:36:42.752 7fa9d28387c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:36:42.752 7fa9d28387c0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:36:42.753 7fa9d28387c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:36:42.753 7fa9d28387c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:36:42.753 7fa9d28387c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:36:42.753 7fa9d31f7d60 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:36:42.754 7fa9d31f7d60 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:36:50.019 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:37:06.090 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:37:12.751 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:37:12.752 7fa9d30e2720 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:37:12.752 7fa9d30e2720 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:37:12.752 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:37:12.752 7fa9d30e2720 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:37:12.752 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:12.752 7fa9d30e2720 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:37:12.753 7fa9d30e2720 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:12.753 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:12.753 7fa9d30e2720 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 12 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:37:12.753 7fa9d30e2720 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:16.753 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:37:16.754 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:37:16.754 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:37:16.754 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:37:16.755 7fa9d2abd5e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:37:16.755 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:37:16.755 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:37:16.755 7fa9d2abd5e0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:37:16.755 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:37:16.755 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:37:16.755 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:37:16.755 7fa9d2b90ea0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:37:16.756 7fa9d2b90ea0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:37:22.099 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:37:38.166 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:37:46.754 7fa9d2855c20 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:37:46.755 7fa9d2855c20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:37:46.755 7fa9d2855c20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:37:46.755 7fa9d2855c20 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:37:46.755 7fa9d2855c20 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:37:46.755 7fa9d2855c20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:46.755 7fa9d2855c20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:37:46.756 7fa9d2855c20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:46.756 7fa9d2855c20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:46.756 7fa9d2855c20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 13 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:37:46.756 7fa9d2855c20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:50.756 7fa9d28559a0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:37:50.758 7fa9d28559a0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:37:50.758 7fa9d28559a0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:37:50.758 7fa9d28559a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:37:50.758 7fa9d28559a0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:37:50.758 7fa9d28559a0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:37:50.758 7fa9d28559a0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:37:50.758 7fa9d28559a0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:37:50.758 7fa9d28559a0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:37:50.759 7fa9d28559a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:37:50.759 7fa9d28559a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:37:50.759 7fa9d31f7d60 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:37:50.759 7fa9d31f7d60 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:37:54.236 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:38:10.275 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:38:20.757 7fa9d31f7540 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:38:20.758 7fa9d31f7540 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:38:20.758 7fa9d31f7540 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:38:20.758 7fa9d31f7540 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:38:20.758 7fa9d31f7540 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:38:20.758 7fa9d31f7540 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:20.758 7fa9d31f7540 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:38:20.758 7fa9d31f7540 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:20.759 7fa9d31f7540 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:20.759 7fa9d31f7540 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 14 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:38:20.759 7fa9d31f7540 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:24.759 7fa9d2855c20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:38:24.760 7fa9d2855c20 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:38:24.760 7fa9d2855c20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:38:24.760 7fa9d2855c20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:38:24.760 7fa9d2855c20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:38:24.761 7fa9d2855c20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:38:24.761 7fa9d2855c20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:38:24.761 7fa9d2855c20 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:38:24.761 7fa9d2855c20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:38:24.761 7fa9d2855c20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:38:24.761 7fa9d2855c20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:38:24.761 7fa9d2838900 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:38:24.762 7fa9d2838900 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:38:26.354 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:38:42.417 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:38:54.760 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:38:54.761 7fa9d2b90400 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:38:54.761 7fa9d2b90400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:38:54.761 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:38:54.761 7fa9d2b90400 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:38:54.761 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:54.761 7fa9d2b90400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:38:54.761 7fa9d2b90400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:54.761 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:54.761 7fa9d2b90400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 15 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:38:54.761 7fa9d2b90400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:58.516 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:38:58.771 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:38:58.772 7fa9d30e2720 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:38:58.772 7fa9d30e2720 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:38:58.773 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:38:58.773 7fa9d30e2720 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:38:58.773 7fa9d30e2720 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:38:58.773 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:38:58.773 7fa9d30e2720 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:38:58.773 7fa9d30e2720 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:38:58.773 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:38:58.773 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:38:58.774 7fa9d2b909a0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:38:58.774 7fa9d2b909a0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:39:14.607 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:39:28.773 7fa9d31f75e0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:39:28.773 7fa9d31f75e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:39:28.774 7fa9d31f75e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:39:28.774 7fa9d31f75e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:39:28.774 7fa9d31f75e0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:39:28.774 7fa9d31f75e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:39:28.774 7fa9d31f75e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:39:28.774 7fa9d31f75e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:39:28.774 7fa9d31f75e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:39:28.775 7fa9d31f75e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 16 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:39:28.775 7fa9d31f75e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:39:30.698 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:39:32.774 7fa9d2b90ea0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:39:32.776 7fa9d2b90ea0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:39:32.776 7fa9d2b90ea0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:39:32.776 7fa9d2b90ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:39:32.776 7fa9d2b90ea0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:39:32.776 7fa9d2b90ea0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:39:32.776 7fa9d2b90ea0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:39:32.776 7fa9d2b90ea0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:39:32.776 7fa9d2b90ea0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:39:32.777 7fa9d2b90ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:39:32.777 7fa9d2b90ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:39:32.777 7fa9d31f7860 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:39:32.777 7fa9d31f7860 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:39:46.777 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:40:02.777 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:40:02.777 7fa9d2b90400 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:40:02.778 7fa9d2b90400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:40:02.778 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:40:02.778 7fa9d2b90400 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:40:02.778 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:40:02.778 7fa9d2b90400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:40:02.778 7fa9d2b90400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:40:02.778 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:40:02.778 7fa9d2b90400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 17 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:40:02.778 7fa9d2b90400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:40:02.820 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:40:06.778 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:40:06.780 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:40:06.780 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:40:06.780 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:40:06.780 7fa9d30e27c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:40:06.780 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:40:06.780 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:40:06.780 7fa9d30e27c0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:40:06.781 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:40:06.781 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:40:06.781 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:40:06.782 7fa9d300e0e0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:40:06.783 7fa9d300e0e0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:40:18.875 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:40:24.729 7fa9d30e2720 [contrail-analytics-api] [DEBUG]: resource list for database-node is None 09/14/2026 02:40:24.730 7fa9d30d8a40 [contrail-analytics-api] [INFO]: db usage:{} 09/14/2026 02:40:24.732 7fa9d30e2720 [contrail-analytics-api] [DEBUG]: resource list for database-node is None 09/14/2026 02:40:24.733 7fa9d30d8a40 [contrail-analytics-api] [INFO]: pending compaction tasks :{} 09/14/2026 02:40:34.954 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:40:36.779 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:40:36.780 7fa9d31f72c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:40:36.780 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:40:36.780 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:40:36.781 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:40:36.781 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:40:36.781 7fa9d31f72c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:40:36.781 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:40:36.781 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:40:36.781 7fa9d31f72c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 18 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:40:36.781 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:40:40.781 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:40:40.783 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:40:40.783 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:40:40.783 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:40:40.783 7fa9d30e2ea0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:40:40.783 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:40:40.783 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:40:40.783 7fa9d30e2ea0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:40:40.784 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:40:40.784 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:40:40.784 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:40:40.784 7fa9d31f7f40 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:40:40.785 7fa9d31f7f40 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:40:51.027 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:41:07.094 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:41:10.783 7fa9d2838400 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:41:10.783 7fa9d2838400 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:41:10.784 7fa9d2838400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:41:10.784 7fa9d2838400 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:41:10.784 7fa9d2838400 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:41:10.784 7fa9d2838400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:10.784 7fa9d2838400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:41:10.784 7fa9d2838400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:10.784 7fa9d2838400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:10.784 7fa9d2838400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 19 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:41:10.784 7fa9d2838400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:14.784 7fa9d2838400 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:41:14.786 7fa9d2838400 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:41:14.786 7fa9d2838400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:41:14.786 7fa9d2838400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:41:14.786 7fa9d2838400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:41:14.786 7fa9d2838400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:41:14.786 7fa9d2838400 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:41:14.786 7fa9d2838400 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:41:14.787 7fa9d2838400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:41:14.787 7fa9d2838400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:41:14.787 7fa9d2838400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:41:14.787 7fa9d2b909a0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:41:14.788 7fa9d2b909a0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:41:23.146 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:41:39.226 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:41:44.785 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:41:44.786 7fa9d2ff9f40 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:41:44.786 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:41:44.787 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:41:44.787 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:41:44.787 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:44.787 7fa9d2ff9f40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:41:44.787 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:44.787 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:44.787 7fa9d2ff9f40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 20 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:41:44.787 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:48.787 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:41:48.788 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:41:48.788 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:41:48.788 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:41:48.789 7fa9d2ff9f40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:41:48.789 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:41:48.789 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:41:48.789 7fa9d2ff9f40 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:41:48.789 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:41:48.790 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:41:48.790 7fa9d2ff9f40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:41:48.790 7fa9d31f7860 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:41:48.791 7fa9d31f7860 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:41:55.307 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:42:11.357 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:42:18.788 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:42:18.788 7fa9d31f72c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:42:18.789 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:42:18.789 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:42:18.789 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:42:18.789 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:18.789 7fa9d31f72c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:42:18.789 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:18.789 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:18.789 7fa9d31f72c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 21 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:42:18.789 7fa9d31f72c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:22.790 7fa9d28559a0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:42:22.791 7fa9d28559a0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:42:22.791 7fa9d28559a0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:42:22.791 7fa9d28559a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:42:22.791 7fa9d28559a0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:42:22.791 7fa9d28559a0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:42:22.791 7fa9d28559a0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:42:22.791 7fa9d28559a0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:42:22.792 7fa9d28559a0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:42:22.792 7fa9d28559a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:42:22.792 7fa9d28559a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:42:22.792 7fa9d2b909a0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:42:22.793 7fa9d2b909a0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:42:27.406 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:42:43.421 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:42:52.791 7fa9d30e24a0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:42:52.792 7fa9d30e24a0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:42:52.792 7fa9d30e24a0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:42:52.792 7fa9d30e24a0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:42:52.792 7fa9d30e24a0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:42:52.792 7fa9d30e24a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:52.793 7fa9d30e24a0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:42:52.793 7fa9d30e24a0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:52.793 7fa9d30e24a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:52.793 7fa9d30e24a0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 22 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:42:52.793 7fa9d30e24a0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:56.793 7fa9d2b90ea0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:42:56.795 7fa9d2b90ea0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:42:56.795 7fa9d2b90ea0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:42:56.795 7fa9d2b90ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:42:56.795 7fa9d2b90ea0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:42:56.795 7fa9d2b90ea0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:42:56.795 7fa9d2b90ea0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:42:56.795 7fa9d2b90ea0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:42:56.796 7fa9d2b90ea0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:42:56.796 7fa9d2b90ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:42:56.796 7fa9d2b90ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:42:56.796 7fa9d2838400 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:42:56.797 7fa9d2838400 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:42:59.427 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:43:15.449 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:43:26.794 7fa9d303e180 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:43:26.795 7fa9d303e180 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:43:26.795 7fa9d303e180 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:43:26.795 7fa9d303e180 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:43:26.795 7fa9d303e180 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:43:26.795 7fa9d303e180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:43:26.796 7fa9d303e180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:43:26.796 7fa9d303e180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:43:26.796 7fa9d303e180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:43:26.796 7fa9d303e180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 23 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:43:26.796 7fa9d303e180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:43:30.795 7fa9d28559a0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:43:30.797 7fa9d28559a0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:43:30.797 7fa9d28559a0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:43:30.797 7fa9d28559a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:43:30.797 7fa9d28559a0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:43:30.797 7fa9d28559a0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:43:30.797 7fa9d28559a0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:43:30.798 7fa9d28559a0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:43:30.798 7fa9d28559a0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:43:30.798 7fa9d28559a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:43:30.798 7fa9d28559a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:43:30.798 7fa9d300e0e0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:43:30.799 7fa9d300e0e0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:43:31.485 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:43:47.539 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:44:00.799 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:44:00.799 7fa9d30e2ea0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:44:00.800 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:44:00.801 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:44:00.801 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:44:00.801 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:00.801 7fa9d30e2ea0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:44:00.801 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:00.802 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:00.802 7fa9d30e2ea0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 24 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:44:00.802 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:03.609 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:44:04.800 7fa9d363aa40 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:44:04.801 7fa9d363aa40 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:44:04.802 7fa9d363aa40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:44:04.802 7fa9d363aa40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:44:04.802 7fa9d363aa40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:44:04.802 7fa9d363aa40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:44:04.802 7fa9d363aa40 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:44:04.802 7fa9d363aa40 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:44:04.802 7fa9d363aa40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:44:04.802 7fa9d363aa40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:44:04.803 7fa9d363aa40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:44:04.803 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:44:04.803 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:44:19.619 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:44:34.802 7fa9d28387c0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:44:34.802 7fa9d28387c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:44:34.802 7fa9d28387c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:44:34.802 7fa9d28387c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:44:34.803 7fa9d28387c0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:44:34.803 7fa9d28387c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:34.803 7fa9d28387c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:44:34.803 7fa9d28387c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:34.803 7fa9d28387c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:34.803 7fa9d28387c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 25 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:44:34.803 7fa9d28387c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:35.705 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:44:38.803 7fa9d28559a0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:44:38.804 7fa9d28559a0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:44:38.804 7fa9d28559a0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:44:38.804 7fa9d28559a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:44:38.805 7fa9d28559a0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:44:38.805 7fa9d28559a0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:44:38.805 7fa9d28559a0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:44:38.805 7fa9d28559a0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:44:38.805 7fa9d28559a0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:44:38.805 7fa9d28559a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:44:38.805 7fa9d28559a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:44:38.805 7fa9d303e680 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:44:38.806 7fa9d303e680 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:44:51.712 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:45:07.772 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:45:08.804 7fa9d30e24a0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:45:08.805 7fa9d30e24a0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:45:08.805 7fa9d30e24a0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:45:08.805 7fa9d30e24a0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:45:08.805 7fa9d30e24a0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:45:08.805 7fa9d30e24a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:08.806 7fa9d30e24a0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:45:08.806 7fa9d30e24a0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:08.806 7fa9d30e24a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:08.806 7fa9d30e24a0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 26 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:45:08.806 7fa9d30e24a0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:12.805 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:45:12.807 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:45:12.807 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:45:12.807 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:45:12.807 7fa9d30e27c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:45:12.807 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:45:12.808 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:45:12.808 7fa9d30e27c0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:45:12.808 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:45:12.808 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:45:12.808 7fa9d30e27c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:45:12.809 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:45:12.809 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:45:23.811 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:45:39.821 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:45:42.807 7fa9d2b909a0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:45:42.808 7fa9d2b909a0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:45:42.808 7fa9d2b909a0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:45:42.808 7fa9d2b909a0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:45:42.808 7fa9d2b909a0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:45:42.808 7fa9d2b909a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:42.809 7fa9d2b909a0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:45:42.809 7fa9d2b909a0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:42.809 7fa9d2b909a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:42.809 7fa9d2b909a0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 27 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:45:42.809 7fa9d2b909a0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:46.808 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:45:46.809 7fa9d2b90400 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:45:46.809 7fa9d2b90400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:45:46.810 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:45:46.810 7fa9d2b90400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:45:46.810 7fa9d2b90400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:45:46.810 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:45:46.810 7fa9d2b90400 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:45:46.810 7fa9d2b90400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:45:46.810 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:45:46.810 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:45:46.811 7fa9d303e360 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:45:46.811 7fa9d303e360 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:45:55.912 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:46:11.947 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:46:16.811 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:46:16.811 7fa9d2b90400 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:46:16.812 7fa9d2b90400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:46:16.812 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:46:16.812 7fa9d2b90400 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:46:16.812 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:46:16.812 7fa9d2b90400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:46:16.812 7fa9d2b90400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:46:16.812 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:46:16.812 7fa9d2b90400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 28 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:46:16.813 7fa9d2b90400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:46:20.812 7fa9d2b909a0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:46:20.814 7fa9d2b909a0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:46:20.814 7fa9d2b909a0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:46:20.814 7fa9d2b909a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:46:20.814 7fa9d2b909a0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:46:20.814 7fa9d2b909a0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:46:20.815 7fa9d2b909a0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:46:20.815 7fa9d2b909a0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:46:20.815 7fa9d2b909a0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:46:20.815 7fa9d2b909a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:46:20.816 7fa9d2b909a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:46:20.816 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:46:20.817 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:46:27.959 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:46:44.003 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:46:50.814 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:46:50.814 7fa9d30e2720 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:46:50.815 7fa9d30e2720 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:46:50.815 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:46:50.815 7fa9d30e2720 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:46:50.815 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:46:50.815 7fa9d30e2720 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:46:50.815 7fa9d30e2720 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:46:50.815 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:46:50.815 7fa9d30e2720 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 29 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:46:50.815 7fa9d30e2720 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:46:54.815 7fa9d2838900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:46:54.817 7fa9d2838900 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:46:54.817 7fa9d2838900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:46:54.817 7fa9d2838900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:46:54.817 7fa9d2838900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:46:54.817 7fa9d2838900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:46:54.818 7fa9d2838900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:46:54.818 7fa9d2838900 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:46:54.818 7fa9d2838900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:46:54.818 7fa9d2838900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:46:54.818 7fa9d2838900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:46:54.819 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:46:54.820 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:47:00.079 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:47:16.092 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:47:24.817 7fa9d303e720 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:47:24.818 7fa9d303e720 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:47:24.818 7fa9d303e720 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:47:24.818 7fa9d303e720 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:47:24.818 7fa9d303e720 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:47:24.818 7fa9d303e720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:47:24.818 7fa9d303e720 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:47:24.818 7fa9d303e720 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:47:24.818 7fa9d303e720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:47:24.819 7fa9d303e720 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 30 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:47:24.819 7fa9d303e720 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:47:28.818 7fa9d30e24a0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:47:28.819 7fa9d30e24a0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:47:28.820 7fa9d30e24a0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:47:28.820 7fa9d30e24a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:47:28.820 7fa9d30e24a0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:47:28.820 7fa9d30e24a0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:47:28.820 7fa9d30e24a0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:47:28.820 7fa9d30e24a0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:47:28.820 7fa9d30e24a0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:47:28.821 7fa9d30e24a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:47:28.821 7fa9d30e24a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:47:28.821 7fa9d303e180 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:47:28.821 7fa9d303e180 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:47:32.171 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:47:48.202 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:47:58.819 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:47:58.820 7fa9d1d88a40 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:47:58.820 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:47:58.820 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:47:58.820 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:47:58.820 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:47:58.821 7fa9d1d88a40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:47:58.821 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:47:58.821 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:47:58.821 7fa9d1d88a40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 31 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:47:58.821 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:48:02.820 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:48:02.821 7fa9d2b90400 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:48:02.822 7fa9d2b90400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:48:02.822 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:48:02.822 7fa9d2b90400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:48:02.822 7fa9d2b90400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:48:02.822 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:48:02.822 7fa9d2b90400 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:48:02.822 7fa9d2b90400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:48:02.822 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:48:02.823 7fa9d2b90400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:48:02.823 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:48:02.823 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:48:04.287 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:48:20.352 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:48:32.821 7fa9d303e680 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:48:32.822 7fa9d303e680 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:48:32.822 7fa9d303e680 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:48:32.823 7fa9d303e680 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:48:32.823 7fa9d303e680 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:48:32.823 7fa9d303e680 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:48:32.823 7fa9d303e680 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:48:32.823 7fa9d303e680 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:48:32.823 7fa9d303e680 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:48:32.823 7fa9d303e680 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 32 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:48:32.823 7fa9d303e680 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:48:36.385 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:48:36.822 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:48:36.824 7fa9d30e2720 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:48:36.824 7fa9d30e2720 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:48:36.824 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:48:36.824 7fa9d30e2720 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:48:36.824 7fa9d30e2720 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:48:36.824 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:48:36.825 7fa9d30e2720 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:48:36.825 7fa9d30e2720 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:48:36.825 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:48:36.825 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:48:36.825 7fa9d303e180 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:48:36.826 7fa9d303e180 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:48:52.480 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:49:06.824 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:49:06.824 7fa9d1d88a40 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:49:06.825 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:49:06.825 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:49:06.825 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:49:06.825 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:49:06.825 7fa9d1d88a40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:49:06.825 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:49:06.825 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:49:06.825 7fa9d1d88a40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 33 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:49:06.825 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:49:08.569 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:49:10.825 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:49:10.827 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:49:10.827 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:49:10.827 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:49:10.827 7fa9d1d88a40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:49:10.827 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:49:10.827 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:49:10.828 7fa9d1d88a40 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:49:10.828 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:49:10.828 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:49:10.828 7fa9d1d88a40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:49:10.828 7fa9d2855c20 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:49:10.829 7fa9d2855c20 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:49:24.672 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:49:40.746 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:49:40.827 7fa9d300e0e0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:49:40.828 7fa9d300e0e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:49:40.828 7fa9d300e0e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:49:40.828 7fa9d300e0e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:49:40.828 7fa9d300e0e0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:49:40.828 7fa9d300e0e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:49:40.828 7fa9d300e0e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:49:40.829 7fa9d300e0e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:49:40.829 7fa9d300e0e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:49:40.829 7fa9d300e0e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 34 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:49:40.829 7fa9d300e0e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:49:44.828 7fa9d300e0e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:49:44.830 7fa9d300e0e0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:49:44.830 7fa9d300e0e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:49:44.830 7fa9d300e0e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:49:44.830 7fa9d300e0e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:49:44.830 7fa9d300e0e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:49:44.830 7fa9d300e0e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:49:44.830 7fa9d300e0e0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:49:44.831 7fa9d300e0e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:49:44.831 7fa9d300e0e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:49:44.831 7fa9d300e0e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:49:44.831 7fa9d303e2c0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:49:44.832 7fa9d303e2c0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:49:56.823 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:50:12.862 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:50:14.830 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:50:14.830 7fa9d2abd5e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:50:14.831 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:50:14.831 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:50:14.831 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:50:14.831 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:50:14.831 7fa9d2abd5e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:50:14.831 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:50:14.831 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:50:14.831 7fa9d2abd5e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 35 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:50:14.831 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:50:18.832 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:50:18.833 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:50:18.833 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:50:18.833 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:50:18.833 7fa9d2abd5e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:50:18.834 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:50:18.834 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:50:18.834 7fa9d2abd5e0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:50:18.834 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:50:18.834 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:50:18.834 7fa9d2abd5e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:50:18.834 7fa9d28559a0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:50:18.835 7fa9d28559a0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:50:24.737 7fa9d2abd5e0 [contrail-analytics-api] [DEBUG]: resource list for database-node is None 09/14/2026 02:50:24.738 7fa9d30d8a40 [contrail-analytics-api] [INFO]: db usage:{} 09/14/2026 02:50:24.742 7fa9d2abd5e0 [contrail-analytics-api] [DEBUG]: resource list for database-node is None 09/14/2026 02:50:24.742 7fa9d30d8a40 [contrail-analytics-api] [INFO]: pending compaction tasks :{} 09/14/2026 02:50:28.869 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:50:40.956 7fa9d30e2ea0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/14/2026 02:50:44.963 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:50:48.833 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:50:48.833 7fa9d30e2ea0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:50:48.834 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:50:48.834 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:50:48.834 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:50:48.834 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:50:48.834 7fa9d30e2ea0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:50:48.834 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:50:48.834 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:50:48.834 7fa9d30e2ea0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 36 pid = 1 http_port = 8090 start_time = 1789353024721529 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.38:8086, 10.0.0.189:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:50:48.834 7fa9d30e2ea0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:50:52.834 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:50:52.836 7fa9d30e2720 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:50:52.836 7fa9d30e2720 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:50:52.836 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:50:52.836 7fa9d30e2720 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:50:52.836 7fa9d30e2720 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:50:52.836 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:50:52.836 7fa9d30e2720 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:50:52.837 7fa9d30e2720 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:50:52.837 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:50:52.837 7fa9d30e2720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:50:52.837 7fa9d303e720 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:50:52.838 7fa9d303e720 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:51:01.004 7fa9d300e220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start