09/14/2026 02:30:24.491 7fbcbe5eef40 [contrail-analytics-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 09/14/2026 02:30:24.491 7fbcbe5eef40 [contrail-analytics-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 09/14/2026 02:30:24.491 7fbcbe5eef40 [contrail-analytics-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 09/14/2026 02:30:24.491 7fbcbe5eef40 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/14/2026 02:30:24.553 7fbcbe5eef40 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 09/14/2026 02:30:24.554 7fbcbb1717c0 [contrail-analytics-api] [ERROR]: Cannot write http_port 8090 to /tmp/contrail-analytics-api.0.http_port 09/14/2026 02:30:24.554 7fbcbb1717c0 [contrail-analytics-api] [ERROR]: Starting Introspect on HTTP Port 8090 09/14/2026 02:30:24.554 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Processing event[EvStart] in state[none] 09/14/2026 02:30:24.555 7fbcbbabaf40 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/14/2026 02:30:24.555 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 09/14/2026 02:30:24.555 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.555 7fbcbbabaf40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, ] description = >>, ] >> 09/14/2026 02:30:24.556 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.556 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.556 7fbcbbabaf40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Initializing description = Redis Instance initialized >>, ] description = Redis-UVE:10.0.0.38:6379[Redis Instance initialized] connection down >>, ] >> 09/14/2026 02:30:24.556 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.556 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.556 7fbcbbabaf40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Initializing description = Redis Instance initialized >>, ] description = Redis-UVE:10.0.0.38:6379[Redis Instance initialized], Redis-UVE:10.0.0.189:6379[Redis Instance initialized] connection down >>, ] >> 09/14/2026 02:30:24.556 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.556 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.556 7fbcbbabaf40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Initializing description = Redis Instance initialized >>, ] description = Redis-UVE:10.0.0.38:6379[Redis Instance initialized], Redis-UVE:10.0.0.189:6379[Redis Instance initialized], Redis-UVE:10.0.0.50:6379[Redis Instance initialized] connection down >>, ] >> 09/14/2026 02:30:24.556 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.556 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.556 7fbcbbabaf40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, ] description = Redis-UVE:10.0.0.38:6379[Redis Instance initialized], Redis-UVE:10.0.0.189:6379[Redis Instance initialized], Redis-UVE:10.0.0.50:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized] connection down >>, ] >> 09/14/2026 02:30:24.556 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.556 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.556 7fbcbbabaf40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] AnalyticsApiInfoUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. analytics_node_ip = { rest_api_ip : 10.0.0.38host_ip : 10.0.0.38 } >> 09/14/2026 02:30:24.556 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.557 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.557 7fbcbbabaf40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Redis-UVE:10.0.0.38:6379[Redis Instance initialized], Redis-UVE:10.0.0.189:6379[Redis Instance initialized], Redis-UVE:10.0.0.50:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/14/2026 02:30:24.557 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.557 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.557 7fbcbbabaf40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 7 max_sm_queue_count = 7 >> 09/14/2026 02:30:24.557 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.558 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:30:24.565 7fbcbb1f8c20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.565 7fbcbb1f8c20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Redis-UVE:10.0.0.38:6379[Redis Instance initialized], Redis-UVE:10.0.0.189:6379[Redis Instance initialized], Redis-UVE:10.0.0.50:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 09/14/2026 02:30:24.566 7fbcbb1f8c20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.571 7fbcbb21a900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.571 7fbcbb21a900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Redis-UVE:10.0.0.189:6379[Redis Instance initialized], Redis-UVE:10.0.0.50:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 09/14/2026 02:30:24.571 7fbcbb21a900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.574 7fbcbb9e3c20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.575 7fbcbb9e3c20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Redis-UVE:10.0.0.189:6379[Redis Instance initialized], Redis-UVE:10.0.0.50:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:30:24.575 7fbcbb9e3c20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.576 7fbcbb9e3c20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.577 7fbcbb9e3c20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Redis-UVE:10.0.0.50:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:30:24.577 7fbcbb9e3c20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.585 7fbcbb9e3c20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:24.585 7fbcbb9e3c20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:30:24.585 7fbcbb9e3c20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:28.555 7fbcbb21a900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:30:28.557 7fbcbb21a900 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:30:28.557 7fbcbb21a900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:30:28.557 7fbcbb21a900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:30:28.557 7fbcbb21a900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:30:28.557 7fbcbb21a900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:30:28.557 7fbcbb21a900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:30:28.558 7fbcbb21a900 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:30:28.558 7fbcbb21a900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:30:28.558 7fbcbb21a900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:30:28.558 7fbcbb21a900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:30:28.558 7fbcbc05b5e0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:30:28.560 7fbcbc05b5e0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:30:39.644 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:30:40.645 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:30:56.718 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:30:58.557 7fbcbc02e7c0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:30:58.558 7fbcbc02e7c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:30:58.558 7fbcbc02e7c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:30:58.558 7fbcbc02e7c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:30:58.558 7fbcbc02e7c0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:30:58.558 7fbcbc02e7c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:58.558 7fbcbc02e7c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:30:58.559 7fbcbc02e7c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:58.559 7fbcbc02e7c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:58.559 7fbcbc02e7c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:30:58.559 7fbcbc02e7c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:31:02.559 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:31:02.560 7fbcbb575400 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:31:02.560 7fbcbb575400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:31:02.560 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:31:02.560 7fbcbb575400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:31:02.560 7fbcbb575400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:31:02.560 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:31:02.561 7fbcbb575400 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:31:02.561 7fbcbb575400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:31:02.561 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:31:02.561 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:31:02.561 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:31:02.562 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:31:12.779 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:31:28.832 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:31:32.560 7fbcbb7ef720 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:31:32.560 7fbcbb7ef720 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:31:32.561 7fbcbb7ef720 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:31:32.561 7fbcbb7ef720 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:31:32.561 7fbcbb7ef720 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:31:32.561 7fbcbb7ef720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:31:32.561 7fbcbb7ef720 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:31:32.561 7fbcbb7ef720 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:31:32.561 7fbcbb7ef720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:31:32.561 7fbcbb7ef720 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 2 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:31:32.561 7fbcbb7ef720 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:31:36.561 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:31:36.562 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:31:36.563 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:31:36.563 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:31:36.563 7fbcbb9e34a0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:31:36.563 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:31:36.563 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:31:36.563 7fbcbb9e34a0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:31:36.563 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:31:36.564 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:31:36.564 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:31:36.564 7fbcbc05b2c0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:31:36.564 7fbcbc05b2c0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:31:44.838 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:32:00.899 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:32:06.563 7fbcbb5750e0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:32:06.563 7fbcbb5750e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:32:06.564 7fbcbb5750e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:32:06.564 7fbcbb5750e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:32:06.564 7fbcbb5750e0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:32:06.564 7fbcbb5750e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:06.564 7fbcbb5750e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:32:06.564 7fbcbb5750e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:06.564 7fbcbb5750e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:06.564 7fbcbb5750e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 3 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:32:06.564 7fbcbb5750e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:10.564 7fbcbb21a900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:32:10.565 7fbcbb21a900 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:32:10.565 7fbcbb21a900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:32:10.565 7fbcbb21a900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:32:10.566 7fbcbb21a900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:32:10.566 7fbcbb21a900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:32:10.566 7fbcbb21a900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:32:10.566 7fbcbb21a900 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:32:10.566 7fbcbb21a900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:32:10.566 7fbcbb21a900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:32:10.566 7fbcbb21a900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:32:10.567 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:32:10.567 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:32:16.996 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:32:33.096 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:32:40.566 7fbcbb9e37c0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:32:40.566 7fbcbb9e37c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:32:40.567 7fbcbb9e37c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:32:40.567 7fbcbb9e37c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:32:40.567 7fbcbb9e37c0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:32:40.567 7fbcbb9e37c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:40.567 7fbcbb9e37c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:32:40.567 7fbcbb9e37c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:40.567 7fbcbb9e37c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:40.567 7fbcbb9e37c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:32:40.567 7fbcbb9e37c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:44.568 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:32:44.569 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:32:44.569 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:32:44.569 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:32:44.569 7fbcbb575ea0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:32:44.569 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:32:44.569 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:32:44.569 7fbcbb575ea0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:32:44.570 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:32:44.570 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:32:44.570 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:32:44.570 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:32:44.571 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:32:49.106 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:33:05.118 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:33:14.569 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:33:14.569 7fbcbbabaf40 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:33:14.570 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:33:14.570 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:33:14.570 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:33:14.570 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:33:14.570 7fbcbbabaf40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:33:14.570 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:33:14.570 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:33:14.571 7fbcbbabaf40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:33:14.571 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:33:18.570 7fbcbc02e7c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:33:18.572 7fbcbc02e7c0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:33:18.572 7fbcbc02e7c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:33:18.572 7fbcbc02e7c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:33:18.572 7fbcbc02e7c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:33:18.572 7fbcbc02e7c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:33:18.572 7fbcbc02e7c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:33:18.572 7fbcbc02e7c0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:33:18.573 7fbcbc02e7c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:33:18.573 7fbcbc02e7c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:33:18.573 7fbcbc02e7c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:33:18.573 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:33:18.574 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:33:21.138 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:33:37.170 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:33:48.572 7fbcbb49d5e0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:33:48.572 7fbcbb49d5e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:33:48.573 7fbcbb49d5e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:33:48.573 7fbcbb49d5e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:33:48.573 7fbcbb49d5e0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:33:48.573 7fbcbb49d5e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:33:48.573 7fbcbb49d5e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:33:48.573 7fbcbb49d5e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:33:48.573 7fbcbb49d5e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:33:48.574 7fbcbb49d5e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 6 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:33:48.574 7fbcbb49d5e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:33:52.573 7fbcbbad20e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:33:52.575 7fbcbbad20e0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:33:52.575 7fbcbbad20e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:33:52.575 7fbcbbad20e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:33:52.575 7fbcbbad20e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:33:52.575 7fbcbbad20e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:33:52.575 7fbcbbad20e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:33:52.575 7fbcbbad20e0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:33:52.576 7fbcbbad20e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:33:52.576 7fbcbbad20e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:33:52.576 7fbcbbad20e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:33:52.576 7fbcbc020a40 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:33:52.577 7fbcbc020a40 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:33:53.213 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:34:09.294 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:34:22.575 7fbcbc05b540 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:34:22.575 7fbcbc05b540 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:34:22.576 7fbcbc05b540 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:34:22.576 7fbcbc05b540 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:34:22.576 7fbcbc05b540 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:34:22.576 7fbcbc05b540 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:22.576 7fbcbc05b540 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:34:22.576 7fbcbc05b540 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:22.576 7fbcbc05b540 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:22.576 7fbcbc05b540 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 7 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:34:22.576 7fbcbc05b540 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:25.332 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:34:26.576 7fbcbb1f8c20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:34:26.578 7fbcbb1f8c20 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:34:26.578 7fbcbb1f8c20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:34:26.578 7fbcbb1f8c20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:34:26.578 7fbcbb1f8c20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:34:26.578 7fbcbb1f8c20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:34:26.578 7fbcbb1f8c20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:34:26.578 7fbcbb1f8c20 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:34:26.579 7fbcbb1f8c20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:34:26.579 7fbcbb1f8c20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:34:26.579 7fbcbb1f8c20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:34:26.579 7fbcbc05ba40 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:34:26.580 7fbcbc05ba40 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:34:41.381 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:34:56.579 7fbcbc020a40 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:34:56.579 7fbcbc020a40 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:34:56.580 7fbcbc020a40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:34:56.580 7fbcbc020a40 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:34:56.580 7fbcbc020a40 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:34:56.580 7fbcbc020a40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:56.580 7fbcbc020a40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:34:56.580 7fbcbc020a40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:56.580 7fbcbc020a40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:56.580 7fbcbc020a40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 8 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:34:56.580 7fbcbc020a40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:57.414 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:35:00.580 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:35:00.582 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:35:00.582 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:35:00.582 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:35:00.582 7fbcbbabaf40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:35:00.582 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:35:00.582 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:35:00.582 7fbcbbabaf40 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:35:00.582 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:35:00.583 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:35:00.583 7fbcbbabaf40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:35:00.583 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:35:00.583 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:35:13.427 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:35:29.463 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:35:30.581 7fbcbc05b5e0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:35:30.582 7fbcbc05b5e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:35:30.582 7fbcbc05b5e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:35:30.582 7fbcbc05b5e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:35:30.582 7fbcbc05b5e0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:35:30.582 7fbcbc05b5e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:35:30.583 7fbcbc05b5e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:35:30.583 7fbcbc05b5e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:35:30.583 7fbcbc05b5e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:35:30.583 7fbcbc05b5e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 9 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:35:30.583 7fbcbc05b5e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:35:34.583 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:35:34.584 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:35:34.584 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:35:34.584 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:35:34.584 7fbcbb9e3720 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:35:34.585 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:35:34.585 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:35:34.585 7fbcbb9e3720 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:35:34.585 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:35:34.585 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:35:34.585 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:35:34.585 7fbcbc05bd60 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:35:34.586 7fbcbc05bd60 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:35:45.499 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:36:01.551 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:36:04.584 7fbcbb5759a0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:36:04.584 7fbcbb5759a0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:36:04.585 7fbcbb5759a0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:36:04.585 7fbcbb5759a0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:36:04.585 7fbcbb5759a0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:36:04.585 7fbcbb5759a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:36:04.585 7fbcbb5759a0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:36:04.585 7fbcbb5759a0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:36:04.586 7fbcbb5759a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:36:04.586 7fbcbb5759a0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 10 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:36:04.586 7fbcbb5759a0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:36:08.585 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:36:08.586 7fbcbb575400 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:36:08.587 7fbcbb575400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:36:08.587 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:36:08.587 7fbcbb575400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:36:08.587 7fbcbb575400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:36:08.587 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:36:08.587 7fbcbb575400 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:36:08.587 7fbcbb575400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:36:08.587 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:36:08.588 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:36:08.588 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:36:08.588 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:36:17.624 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:36:33.645 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:36:38.587 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:36:38.587 7fbcbb9e34a0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:36:38.588 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:36:38.588 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:36:38.588 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:36:38.588 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:36:38.588 7fbcbb9e34a0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:36:38.588 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:36:38.588 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:36:38.588 7fbcbb9e34a0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 11 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:36:38.588 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:36:42.588 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:36:42.589 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:36:42.590 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:36:42.590 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:36:42.590 7fbcbb9e3720 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:36:42.590 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:36:42.590 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:36:42.590 7fbcbb9e3720 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:36:42.590 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:36:42.590 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:36:42.590 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:36:42.591 7fbcbc05ba40 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:36:42.591 7fbcbc05ba40 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:36:49.670 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:37:05.678 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:37:12.590 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:37:12.590 7fbcbb575400 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:37:12.591 7fbcbb575400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:37:12.591 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:37:12.591 7fbcbb575400 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:37:12.591 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:12.591 7fbcbb575400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:37:12.591 7fbcbb575400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:12.591 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:12.591 7fbcbb575400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 12 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:37:12.591 7fbcbb575400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:16.591 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:37:16.592 7fbcbb575400 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:37:16.593 7fbcbb575400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:37:16.593 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:37:16.593 7fbcbb575400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:37:16.593 7fbcbb575400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:37:16.593 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:37:16.593 7fbcbb575400 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:37:16.593 7fbcbb575400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:37:16.593 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:37:16.593 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:37:16.594 7fbcbbad2d60 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:37:16.594 7fbcbbad2d60 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:37:21.748 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:37:37.796 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:37:46.593 7fbcbb5ee4a0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:37:46.593 7fbcbb5ee4a0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:37:46.593 7fbcbb5ee4a0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:37:46.593 7fbcbb5ee4a0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:37:46.594 7fbcbb5ee4a0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:37:46.594 7fbcbb5ee4a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:46.594 7fbcbb5ee4a0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:37:46.594 7fbcbb5ee4a0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:46.594 7fbcbb5ee4a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:46.594 7fbcbb5ee4a0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 13 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:37:46.594 7fbcbb5ee4a0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:50.594 7fbcbb1f89a0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:37:50.596 7fbcbb1f89a0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:37:50.596 7fbcbb1f89a0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:37:50.596 7fbcbb1f89a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:37:50.596 7fbcbb1f89a0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:37:50.596 7fbcbb1f89a0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:37:50.597 7fbcbb1f89a0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:37:50.597 7fbcbb1f89a0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:37:50.597 7fbcbb1f89a0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:37:50.597 7fbcbb1f89a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:37:50.597 7fbcbb1f89a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:37:50.598 7fbcbc05ba40 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:37:50.599 7fbcbc05ba40 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:37:53.835 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:38:09.853 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:38:20.595 7fbcbc05b540 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:38:20.596 7fbcbc05b540 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:38:20.596 7fbcbc05b540 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:38:20.596 7fbcbc05b540 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:38:20.596 7fbcbc05b540 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:38:20.596 7fbcbc05b540 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:20.597 7fbcbc05b540 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:38:20.597 7fbcbc05b540 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:20.597 7fbcbc05b540 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:20.597 7fbcbc05b540 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 14 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:38:20.597 7fbcbc05b540 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:24.597 7fbcbb1f89a0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:38:24.598 7fbcbb1f89a0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:38:24.598 7fbcbb1f89a0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:38:24.598 7fbcbb1f89a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:38:24.599 7fbcbb1f89a0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:38:24.599 7fbcbb1f89a0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:38:24.599 7fbcbb1f89a0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:38:24.599 7fbcbb1f89a0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:38:24.599 7fbcbb1f89a0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:38:24.599 7fbcbb1f89a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:38:24.599 7fbcbb1f89a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:38:24.599 7fbcbb7ef720 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:38:24.600 7fbcbb7ef720 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:38:25.888 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:38:41.904 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:38:54.599 7fbcbb5759a0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:38:54.599 7fbcbb5759a0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:38:54.599 7fbcbb5759a0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:38:54.599 7fbcbb5759a0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:38:54.599 7fbcbb5759a0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:38:54.600 7fbcbb5759a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:54.600 7fbcbb5759a0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:38:54.600 7fbcbb5759a0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:54.600 7fbcbb5759a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:54.600 7fbcbb5759a0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 15 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:38:54.600 7fbcbb5759a0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:57.923 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:38:58.599 7fbcbb21a2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:38:58.601 7fbcbb21a2c0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:38:58.601 7fbcbb21a2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:38:58.601 7fbcbb21a2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:38:58.601 7fbcbb21a2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:38:58.601 7fbcbb21a2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:38:58.601 7fbcbb21a2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:38:58.601 7fbcbb21a2c0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:38:58.602 7fbcbb21a2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:38:58.602 7fbcbb21a2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:38:58.602 7fbcbb21a2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:38:58.602 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:38:58.603 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:39:14.013 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:39:28.600 7fbcbc05b5e0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:39:28.601 7fbcbc05b5e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:39:28.601 7fbcbc05b5e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:39:28.601 7fbcbc05b5e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:39:28.601 7fbcbc05b5e0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:39:28.601 7fbcbc05b5e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:39:28.601 7fbcbc05b5e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:39:28.601 7fbcbc05b5e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:39:28.602 7fbcbc05b5e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:39:28.602 7fbcbc05b5e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 16 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:39:28.602 7fbcbc05b5e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:39:30.108 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:39:32.602 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:39:32.604 7fbcbb575400 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:39:32.604 7fbcbb575400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:39:32.604 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:39:32.604 7fbcbb575400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:39:32.604 7fbcbb575400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:39:32.604 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:39:32.604 7fbcbb575400 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:39:32.605 7fbcbb575400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:39:32.605 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:39:32.605 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:39:32.605 7fbcbc05b860 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:39:32.606 7fbcbc05b860 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:39:46.208 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:40:02.270 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:40:02.604 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:40:02.604 7fbcbb575ea0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:40:02.604 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:40:02.605 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:40:02.605 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:40:02.605 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:40:02.605 7fbcbb575ea0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:40:02.605 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:40:02.605 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:40:02.605 7fbcbb575ea0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 17 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:40:02.605 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:40:06.604 7fbcbb9e37c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:40:06.608 7fbcbb9e37c0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:40:06.608 7fbcbb9e37c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:40:06.608 7fbcbb9e37c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:40:06.608 7fbcbb9e37c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:40:06.608 7fbcbb9e37c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:40:06.608 7fbcbb9e37c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:40:06.608 7fbcbb9e37c0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:40:06.609 7fbcbb9e37c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:40:06.609 7fbcbb9e37c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:40:06.609 7fbcbb9e37c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:40:06.609 7fbcbc05bd60 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:40:06.610 7fbcbc05bd60 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:40:18.304 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:40:24.562 7fbcbb9e3720 [contrail-analytics-api] [DEBUG]: resource list for database-node is None 09/14/2026 02:40:24.563 7fbcbb9dfa40 [contrail-analytics-api] [INFO]: db usage:{} 09/14/2026 02:40:24.565 7fbcbb9e3720 [contrail-analytics-api] [DEBUG]: resource list for database-node is None 09/14/2026 02:40:24.566 7fbcbb9dfa40 [contrail-analytics-api] [INFO]: pending compaction tasks :{} 09/14/2026 02:40:34.356 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:40:36.605 7fbcbc05bd60 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:40:36.605 7fbcbc05bd60 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:40:36.606 7fbcbc05bd60 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:40:36.606 7fbcbc05bd60 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:40:36.606 7fbcbc05bd60 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:40:36.606 7fbcbc05bd60 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:40:36.606 7fbcbc05bd60 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:40:36.606 7fbcbc05bd60 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:40:36.606 7fbcbc05bd60 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:40:36.606 7fbcbc05bd60 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 18 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:40:36.606 7fbcbc05bd60 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:40:40.606 7fbcbbad2d60 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:40:40.608 7fbcbbad2d60 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:40:40.608 7fbcbbad2d60 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:40:40.608 7fbcbbad2d60 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:40:40.608 7fbcbbad2d60 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:40:40.608 7fbcbbad2d60 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:40:40.608 7fbcbbad2d60 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:40:40.609 7fbcbbad2d60 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:40:40.609 7fbcbbad2d60 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:40:40.609 7fbcbbad2d60 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:40:40.609 7fbcbbad2d60 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:40:40.610 7fbcbc05bf40 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:40:40.610 7fbcbc05bf40 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:40:50.391 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:41:06.407 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:41:10.608 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:41:10.608 7fbcbb9e3ea0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:41:10.608 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:41:10.608 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:41:10.609 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:41:10.609 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:10.609 7fbcbb9e3ea0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:41:10.609 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:10.609 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:10.609 7fbcbb9e3ea0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 19 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:41:10.609 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:14.609 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:41:14.610 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:41:14.611 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:41:14.611 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:41:14.611 7fbcbb9e3ea0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:41:14.611 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:41:14.611 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:41:14.611 7fbcbb9e3ea0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:41:14.612 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:41:14.612 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:41:14.612 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:41:14.612 7fbcbb5759a0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:41:14.613 7fbcbb5759a0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:41:22.490 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:41:38.501 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:41:44.610 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:41:44.610 7fbcbb575400 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:41:44.611 7fbcbb575400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:41:44.611 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:41:44.611 7fbcbb575400 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:41:44.611 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:44.611 7fbcbb575400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:41:44.611 7fbcbb575400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:44.611 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:44.611 7fbcbb575400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 20 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:41:44.611 7fbcbb575400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:48.611 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:41:48.612 7fbcbb575400 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:41:48.613 7fbcbb575400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:41:48.613 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:41:48.613 7fbcbb575400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:41:48.613 7fbcbb575400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:41:48.613 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:41:48.613 7fbcbb575400 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:41:48.613 7fbcbb575400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:41:48.613 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:41:48.614 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:41:48.614 7fbcbc05b860 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:41:48.614 7fbcbc05b860 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:41:54.602 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:42:10.620 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:42:18.613 7fbcbc05bd60 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:42:18.613 7fbcbc05bd60 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:42:18.613 7fbcbc05bd60 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:42:18.614 7fbcbc05bd60 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:42:18.614 7fbcbc05bd60 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:42:18.614 7fbcbc05bd60 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:18.614 7fbcbc05bd60 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:42:18.614 7fbcbc05bd60 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:18.614 7fbcbc05bd60 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:18.614 7fbcbc05bd60 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 21 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:42:18.614 7fbcbc05bd60 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:22.614 7fbcbc020a40 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:42:22.615 7fbcbc020a40 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:42:22.615 7fbcbc020a40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:42:22.615 7fbcbc020a40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:42:22.615 7fbcbc020a40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:42:22.615 7fbcbc020a40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:42:22.615 7fbcbc020a40 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:42:22.616 7fbcbc020a40 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:42:22.616 7fbcbc020a40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:42:22.616 7fbcbc020a40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:42:22.616 7fbcbc020a40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:42:22.616 7fbcbb5759a0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:42:22.617 7fbcbb5759a0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:42:26.701 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:42:42.710 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:42:52.615 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:42:52.615 7fbcbb9e3ea0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:42:52.616 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:42:52.616 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:42:52.616 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:42:52.616 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:52.616 7fbcbb9e3ea0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:42:52.616 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:52.616 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:52.616 7fbcbb9e3ea0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 22 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:42:52.616 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:56.616 7fbcbbad2d60 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:42:56.618 7fbcbbad2d60 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:42:56.618 7fbcbbad2d60 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:42:56.618 7fbcbbad2d60 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:42:56.618 7fbcbbad2d60 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:42:56.618 7fbcbbad2d60 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:42:56.618 7fbcbbad2d60 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:42:56.619 7fbcbbad2d60 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:42:56.619 7fbcbbad2d60 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:42:56.619 7fbcbbad2d60 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:42:56.619 7fbcbbad2d60 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:42:56.619 7fbcbc05b860 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:42:56.620 7fbcbc05b860 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:42:58.788 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:43:14.892 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:43:26.618 7fbcbba1e360 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:43:26.618 7fbcbba1e360 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:43:26.619 7fbcbba1e360 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:43:26.619 7fbcbba1e360 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:43:26.619 7fbcbba1e360 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:43:26.619 7fbcbba1e360 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:43:26.619 7fbcbba1e360 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:43:26.619 7fbcbba1e360 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:43:26.619 7fbcbba1e360 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:43:26.619 7fbcbba1e360 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 23 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:43:26.619 7fbcbba1e360 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:43:30.620 7fbcbc02e7c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:43:30.621 7fbcbc02e7c0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:43:30.621 7fbcbc02e7c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:43:30.621 7fbcbc02e7c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:43:30.621 7fbcbc02e7c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:43:30.621 7fbcbc02e7c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:43:30.621 7fbcbc02e7c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:43:30.622 7fbcbc02e7c0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:43:30.622 7fbcbc02e7c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:43:30.622 7fbcbc02e7c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:43:30.622 7fbcbc02e7c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:43:30.622 7fbcbc020a40 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:43:30.623 7fbcbc020a40 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:43:30.909 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:43:46.973 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:44:00.621 7fbcbb5750e0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:44:00.622 7fbcbb5750e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:44:00.622 7fbcbb5750e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:44:00.622 7fbcbb5750e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:44:00.622 7fbcbb5750e0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:44:00.623 7fbcbb5750e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:00.623 7fbcbb5750e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:44:00.623 7fbcbb5750e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:00.623 7fbcbb5750e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:00.623 7fbcbb5750e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 24 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:44:00.623 7fbcbb5750e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:03.001 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:44:04.622 7fbcba7a4a40 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:44:04.624 7fbcba7a4a40 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:44:04.624 7fbcba7a4a40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:44:04.624 7fbcba7a4a40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:44:04.624 7fbcba7a4a40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:44:04.624 7fbcba7a4a40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:44:04.624 7fbcba7a4a40 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:44:04.625 7fbcba7a4a40 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:44:04.625 7fbcba7a4a40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:44:04.625 7fbcba7a4a40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:44:04.625 7fbcba7a4a40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:44:04.625 7fbcbb575400 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:44:04.626 7fbcbb575400 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:44:19.081 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:44:34.624 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:44:34.624 7fbcbb9e34a0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:44:34.625 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:44:34.625 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:44:34.625 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:44:34.625 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:34.625 7fbcbb9e34a0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:44:34.625 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:34.625 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:34.625 7fbcbb9e34a0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 25 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:44:34.625 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:35.095 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:44:38.625 7fbcbb7ef720 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:44:38.627 7fbcbb7ef720 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:44:38.627 7fbcbb7ef720 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:44:38.627 7fbcbb7ef720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:44:38.627 7fbcbb7ef720 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:44:38.627 7fbcbb7ef720 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:44:38.627 7fbcbb7ef720 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:44:38.627 7fbcbb7ef720 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:44:38.628 7fbcbb7ef720 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:44:38.628 7fbcbb7ef720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:44:38.628 7fbcbb7ef720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:44:38.628 7fbcbba1e680 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:44:38.629 7fbcbba1e680 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:44:51.165 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:45:07.223 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:45:08.627 7fbcbb21a2c0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:45:08.627 7fbcbb21a2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:45:08.627 7fbcbb21a2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:45:08.628 7fbcbb21a2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:45:08.628 7fbcbb21a2c0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:45:08.628 7fbcbb21a2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:08.628 7fbcbb21a2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:45:08.628 7fbcbb21a2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:08.628 7fbcbb21a2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:08.628 7fbcbb21a2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 26 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:45:08.628 7fbcbb21a2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:12.628 7fbcba7a4a40 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:45:12.629 7fbcba7a4a40 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:45:12.629 7fbcba7a4a40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:45:12.630 7fbcba7a4a40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:45:12.630 7fbcba7a4a40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:45:12.630 7fbcba7a4a40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:45:12.630 7fbcba7a4a40 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:45:12.630 7fbcba7a4a40 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:45:12.630 7fbcba7a4a40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:45:12.630 7fbcba7a4a40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:45:12.631 7fbcba7a4a40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:45:12.631 7fbcbb9e37c0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:45:12.631 7fbcbb9e37c0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:45:23.295 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:45:39.300 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:45:42.629 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:45:42.629 7fbcbb9e3ea0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:45:42.630 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:45:42.630 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:45:42.630 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:45:42.630 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:42.630 7fbcbb9e3ea0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:45:42.630 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:42.630 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:42.630 7fbcbb9e3ea0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 27 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:45:42.630 7fbcbb9e3ea0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:46.630 7fbcbb5ee4a0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:45:46.632 7fbcbb5ee4a0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:45:46.632 7fbcbb5ee4a0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:45:46.632 7fbcbb5ee4a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:45:46.632 7fbcbb5ee4a0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:45:46.632 7fbcbb5ee4a0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:45:46.632 7fbcbb5ee4a0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:45:46.632 7fbcbb5ee4a0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:45:46.633 7fbcbb5ee4a0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:45:46.633 7fbcbb5ee4a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:45:46.633 7fbcbb5ee4a0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:45:46.633 7fbcbba1e180 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:45:46.634 7fbcbba1e180 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:45:55.307 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:46:11.318 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:46:16.632 7fbcbc05bf40 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:46:16.632 7fbcbc05bf40 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:46:16.632 7fbcbc05bf40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:46:16.632 7fbcbc05bf40 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:46:16.632 7fbcbc05bf40 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:46:16.633 7fbcbc05bf40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:46:16.633 7fbcbc05bf40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:46:16.633 7fbcbc05bf40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:46:16.633 7fbcbc05bf40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:46:16.633 7fbcbc05bf40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 28 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:46:16.633 7fbcbc05bf40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:46:20.633 7fbcbc020a40 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:46:20.635 7fbcbc020a40 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:46:20.635 7fbcbc020a40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:46:20.635 7fbcbc020a40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:46:20.635 7fbcbc020a40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:46:20.635 7fbcbc020a40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:46:20.635 7fbcbc020a40 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:46:20.635 7fbcbc020a40 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:46:20.636 7fbcbc020a40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:46:20.636 7fbcbc020a40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:46:20.636 7fbcbc020a40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:46:20.636 7fbcba7a4a40 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:46:20.636 7fbcba7a4a40 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:46:27.369 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:46:43.466 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:46:50.635 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:46:50.636 7fbcbb9e3720 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:46:50.636 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:46:50.636 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:46:50.636 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:46:50.636 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:46:50.636 7fbcbb9e3720 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:46:50.636 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:46:50.636 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:46:50.637 7fbcbb9e3720 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 29 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:46:50.637 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:46:54.637 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:46:54.638 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:46:54.639 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:46:54.639 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:46:54.639 7fbcbb9e3720 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:46:54.639 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:46:54.639 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:46:54.639 7fbcbb9e3720 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:46:54.640 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:46:54.640 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:46:54.640 7fbcbb9e3720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:46:54.640 7fbcbc02e7c0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:46:54.641 7fbcbc02e7c0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:46:59.491 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:47:15.515 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:47:24.639 7fbcbba1e720 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:47:24.639 7fbcbba1e720 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:47:24.640 7fbcbba1e720 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:47:24.640 7fbcbba1e720 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:47:24.640 7fbcbba1e720 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:47:24.640 7fbcbba1e720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:47:24.640 7fbcbba1e720 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:47:24.640 7fbcbba1e720 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:47:24.640 7fbcbba1e720 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:47:24.640 7fbcbba1e720 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 30 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:47:24.640 7fbcbba1e720 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:47:28.641 7fbcbb9e37c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:47:28.642 7fbcbb9e37c0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:47:28.642 7fbcbb9e37c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:47:28.642 7fbcbb9e37c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:47:28.642 7fbcbb9e37c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:47:28.642 7fbcbb9e37c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:47:28.643 7fbcbb9e37c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:47:28.643 7fbcbb9e37c0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:47:28.643 7fbcbb9e37c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:47:28.643 7fbcbb9e37c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:47:28.643 7fbcbb9e37c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:47:28.643 7fbcbba1e360 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:47:28.644 7fbcbba1e360 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:47:31.548 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:47:47.561 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:47:58.642 7fbcbc020a40 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:47:58.643 7fbcbc020a40 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:47:58.643 7fbcbc020a40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:47:58.643 7fbcbc020a40 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:47:58.643 7fbcbc020a40 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:47:58.643 7fbcbc020a40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:47:58.643 7fbcbc020a40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:47:58.643 7fbcbc020a40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:47:58.643 7fbcbc020a40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:47:58.644 7fbcbc020a40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 31 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:47:58.644 7fbcbc020a40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:48:02.643 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:48:02.645 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:48:02.645 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:48:02.645 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:48:02.645 7fbcbb575ea0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:48:02.645 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:48:02.645 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:48:02.645 7fbcbb575ea0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:48:02.646 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:48:02.646 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:48:02.646 7fbcbb575ea0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:48:02.646 7fbcbb7ef720 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:48:02.646 7fbcbb7ef720 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:48:03.580 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:48:19.700 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:48:32.644 7fbcbba1e680 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:48:32.645 7fbcbba1e680 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:48:32.645 7fbcbba1e680 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:48:32.645 7fbcbba1e680 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:48:32.645 7fbcbba1e680 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:48:32.645 7fbcbba1e680 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:48:32.645 7fbcbba1e680 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:48:32.646 7fbcbba1e680 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:48:32.646 7fbcbba1e680 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:48:32.646 7fbcbba1e680 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 32 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:48:32.646 7fbcbba1e680 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:48:35.742 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:48:36.646 7fbcbb5750e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:48:36.647 7fbcbb5750e0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:48:36.647 7fbcbb5750e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:48:36.647 7fbcbb5750e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:48:36.647 7fbcbb5750e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:48:36.647 7fbcbb5750e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:48:36.647 7fbcbb5750e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:48:36.648 7fbcbb5750e0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:48:36.648 7fbcbb5750e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:48:36.648 7fbcbb5750e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:48:36.648 7fbcbb5750e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:48:36.648 7fbcbba1e2c0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:48:36.649 7fbcbba1e2c0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/14/2026 02:48:51.764 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:48:59.267 7fbcbb5759a0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/14/2026 02:49:06.648 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:49:06.648 7fbcbb575400 [contrail-analytics-api] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:49:06.649 7fbcbb575400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:49:06.649 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:49:06.649 7fbcbb575400 [contrail-analytics-api] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:49:06.649 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:49:06.649 7fbcbb575400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[ClientInit to Idle on EvConnectTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:49:06.649 7fbcbb575400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:49:06.649 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:49:06.649 7fbcbb575400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 33 pid = 1 http_port = 8090 start_time = 1789353024555388 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 8 >> 09/14/2026 02:49:06.649 7fbcbb575400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:49:07.818 7fbcbbad2220 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/14/2026 02:49:10.649 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:49:10.658 7fbcbb575400 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 09/14/2026 02:49:10.659 7fbcbb575400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:49:10.659 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:49:10.659 7fbcbb575400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.38:6379, 10.0.0.189:6379, 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.189:6379 server_addrs = [ 10.0.0.189:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.38:2181, 10.0.0.189:2181, 10.0.0.50:2181, ] status = Down description = Connection time-out >>, << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38:8082, 10.0.0.189:8082, 10.0.0.50:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection time-out], Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 09/14/2026 02:49:10.659 7fbcbb575400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:49:10.659 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:49:10.659 7fbcbb575400 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 09/14/2026 02:49:10.659 7fbcbb575400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:49:10.659 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:49:10.660 7fbcbb575400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:49:10.660 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/14/2026 02:49:10.660 7fbcbb9e34a0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID]