09/01/2025 01:58:58.727 7faad9249680 [contrail-analytics-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 09/01/2025 01:58:58.727 7faad9249680 [contrail-analytics-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 09/01/2025 01:58:58.727 7faad9249680 [contrail-analytics-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 09/01/2025 01:58:58.727 7faad9249680 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 01:58:58.755 7faad9249680 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 09/01/2025 01:58:58.756 7faad52c5cc0 [contrail-analytics-api] [ERROR]: Cannot write http_port 8090 to /tmp/contrail-analytics-api.0.http_port 09/01/2025 01:58:58.756 7faad52c5cc0 [contrail-analytics-api] [ERROR]: Starting Introspect on HTTP Port 8090 09/01/2025 01:58:58.756 7faad6f722c0 [contrail-analytics-api] [INFO]: Processing event[EvStart] in state[none] 09/01/2025 01:58:58.757 7faad6f722c0 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/01/2025 01:58:58.757 7faad6f722c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 09/01/2025 01:58:58.757 7faad6f722c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.757 7faad6f722c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, ] description = >>, ] >> 09/01/2025 01:58:58.757 7faad6f722c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.757 7faad6f722c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.757 7faad6f722c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.249:6379 server_addrs = [ 10.0.0.249:6379, ] status = Initializing description = Redis Instance initialized >>, ] description = Redis-UVE:10.0.0.249:6379[Redis Instance initialized] connection down >>, ] >> 09/01/2025 01:58:58.757 7faad6f722c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.757 7faad6f722c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.757 7faad6f722c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.249:6379 server_addrs = [ 10.0.0.249:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Initializing description = Redis Instance initialized >>, ] description = Redis-UVE:10.0.0.249:6379[Redis Instance initialized], Redis-UVE:10.0.0.38:6379[Redis Instance initialized] connection down >>, ] >> 09/01/2025 01:58:58.758 7faad6f722c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.758 7faad6f722c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.758 7faad6f722c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.249:6379 server_addrs = [ 10.0.0.249:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.131:6379 server_addrs = [ 10.0.0.131:6379, ] status = Initializing description = Redis Instance initialized >>, ] description = Redis-UVE:10.0.0.249:6379[Redis Instance initialized], Redis-UVE:10.0.0.38:6379[Redis Instance initialized], Redis-UVE:10.0.0.131:6379[Redis Instance initialized] connection down >>, ] >> 09/01/2025 01:58:58.758 7faad6f722c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.758 7faad6f722c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.758 7faad6f722c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.249:6379 server_addrs = [ 10.0.0.249:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.131:6379 server_addrs = [ 10.0.0.131:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, ] description = Redis-UVE:10.0.0.249:6379[Redis Instance initialized], Redis-UVE:10.0.0.38:6379[Redis Instance initialized], Redis-UVE:10.0.0.131:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized] connection down >>, ] >> 09/01/2025 01:58:58.758 7faad6f722c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.758 7faad6f722c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.758 7faad6f722c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] AnalyticsApiInfoUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. analytics_node_ip = { rest_api_ip : 10.0.0.131host_ip : 10.0.0.131 } >> 09/01/2025 01:58:58.758 7faad6f722c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.758 7faad6f722c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.758 7faad6f722c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.249:6379 server_addrs = [ 10.0.0.249:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.131:6379 server_addrs = [ 10.0.0.131:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Redis-UVE:10.0.0.249:6379[Redis Instance initialized], Redis-UVE:10.0.0.38:6379[Redis Instance initialized], Redis-UVE:10.0.0.131:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/01/2025 01:58:58.758 7faad6f722c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.758 7faad6f722c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.759 7faad6f722c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 7 max_sm_queue_count = 7 >> 09/01/2025 01:58:58.759 7faad6f722c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.759 7faad6f729a0 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 09/01/2025 01:58:58.765 7faad446c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.766 7faad446c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.249:6379 server_addrs = [ 10.0.0.249:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.131:6379 server_addrs = [ 10.0.0.131:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Redis-UVE:10.0.0.249:6379[Redis Instance initialized], Redis-UVE:10.0.0.38:6379[Redis Instance initialized], Redis-UVE:10.0.0.131:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 09/01/2025 01:58:58.766 7faad446c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.769 7faad446cf40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.769 7faad446cf40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.249:6379 server_addrs = [ 10.0.0.249:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.131:6379 server_addrs = [ 10.0.0.131:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Redis-UVE:10.0.0.38:6379[Redis Instance initialized], Redis-UVE:10.0.0.131:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 09/01/2025 01:58:58.769 7faad446cf40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.771 7faad446cf40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.771 7faad446cf40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.249:6379 server_addrs = [ 10.0.0.249:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Redis-UVE name = 10.0.0.131:6379 server_addrs = [ 10.0.0.131:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Redis-UVE:10.0.0.38:6379[Redis Instance initialized], Redis-UVE:10.0.0.131:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/01/2025 01:58:58.771 7faad446cf40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.773 7faad446cf40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.773 7faad446cf40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.249:6379 server_addrs = [ 10.0.0.249:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.131:6379 server_addrs = [ 10.0.0.131:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Redis-UVE:10.0.0.131:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/01/2025 01:58:58.773 7faad446cf40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.774 7faad446c900 [contrail-analytics-api] [INFO]: Analytics Discovery listen CONNECTED 09/01/2025 01:58:58.774 7faad446c900 [contrail-analytics-api] [INFO]: Analytics Discovery to publish None 09/01/2025 01:58:58.774 7faad446cf40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.775 7faad446cf40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.249:6379 server_addrs = [ 10.0.0.249:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.131:6379 server_addrs = [ 10.0.0.131:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/01/2025 01:58:58.775 7faad446cf40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.775 7faad446cf40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.775 7faad446cf40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.249:6379 server_addrs = [ 10.0.0.249:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.131:6379 server_addrs = [ 10.0.0.131:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper re-established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/01/2025 01:58:58.775 7faad446cf40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.775 7faad4483360 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.775 7faad4483360 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.249:6379 server_addrs = [ 10.0.0.249:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.131:6379 server_addrs = [ 10.0.0.131:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/01/2025 01:58:58.775 7faad4483360 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:58.783 7faad6f729a0 [contrail-analytics-api] [INFO]: Analytics Discovery Watcher AlarmGenerator Children [] 09/01/2025 01:58:58.788 7faad6f729a0 [contrail-analytics-api] [INFO]: Analytics Discovery OpServer reconnect 09/01/2025 01:58:58.788 7faad6f729a0 [contrail-analytics-api] [INFO]: ensure /analytics-discovery-/OpServer 09/01/2025 01:58:58.788 7faad6f729a0 [contrail-analytics-api] [INFO]: zk state CONNECTED (CONNECTED) 09/01/2025 01:58:58.800 7faad6f729a0 [contrail-analytics-api] [INFO]: check for /analytics-discovery-/OpServer/cn-jenkins-deploy-platform-ansible-os-3995-3.-0 09/01/2025 01:59:02.758 7faad446cf40 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:02.759 7faad446cf40 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:02.759 7faad446cf40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:02.759 7faad446cf40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:02.759 7faad446cf40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.249:6379 server_addrs = [ 10.0.0.249:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.131:6379 server_addrs = [ 10.0.0.131:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:02.759 7faad446cf40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:02.759 7faad446cf40 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:02.759 7faad446cf40 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:02.760 7faad446cf40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:02.760 7faad446cf40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.249:6379 server_addrs = [ 10.0.0.249:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.131:6379 server_addrs = [ 10.0.0.131:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:02.760 7faad446cf40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:02.760 7faad446cf40 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:02.760 7faad446cf40 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 01:59:02.760 7faad446cf40 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:03.777 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:03.777 7faad446c360 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.38:6379 server_addrs = [ 10.0.0.38:6379, ] status = Up >>, << type = Redis-UVE name = 10.0.0.131:6379 server_addrs = [ 10.0.0.131:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:03.777 7faad446c360 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:03.777 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:03.778 7faad446c360 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.131:6379 server_addrs = [ 10.0.0.131:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:03.778 7faad446c360 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:03.778 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:03.778 7faad446c360 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:03.778 7faad446c360 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:06.762 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:06.763 7faad446c360 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:06.763 7faad446c360 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:06.763 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:06.763 7faad446c360 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:06.763 7faad446c360 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:06.763 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:06.764 7faad446c360 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:06.764 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:06.764 7faad446c360 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:06.764 7faad446c360 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:06.764 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:06.764 7faad446c360 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 01:59:06.764 7faad446c360 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:07.770 7faad446c360 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABotP3qG73aiUzRS0rr6CwSbSjXU3B09_5CHYX0rmZC5PRCmeSJwC341orZsFJuiEaxmMRbKMcmSo3HU9o_U5YTgWWhyeYxEubE8rttjKgPdtUOFPDiYueoAkACIjtxilyQdTeVdeOl0vkkdVDX5l6_emnwZVf9fPrP2380JH92FgmOwf8 09/01/2025 01:59:07.771 7faad446c360 [contrail-analytics-api] [DEBUG]: user resources are None 09/01/2025 01:59:07.771 7faad446c360 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.38 object_type = vrouter request_url = http://10.0.0.131:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 756 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.32.5 node = cn-jenkins-deploy-platform-ansible-os-3995-3. >> 09/01/2025 01:59:10.764 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:10.766 7faad446c360 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:10.766 7faad446c360 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:10.767 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:10.767 7faad446c360 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:10.767 7faad446c360 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:10.767 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:10.767 7faad446c360 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:10.767 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:10.767 7faad446c360 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:10.767 7faad446c360 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:10.767 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:10.768 7faad446c360 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 01:59:10.768 7faad446c360 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:14.767 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:14.768 7faad446c360 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:14.768 7faad446c360 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:14.768 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:14.769 7faad446c360 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:14.769 7faad446c360 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:14.769 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:14.769 7faad446c360 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:14.769 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:14.769 7faad446c360 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:14.769 7faad446c360 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:14.769 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:14.769 7faad446c360 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 01:59:14.770 7faad446c360 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:18.770 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:18.771 7faad446c360 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:18.771 7faad446c360 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:18.771 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:18.772 7faad446c360 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:18.772 7faad446c360 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:18.772 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:18.772 7faad446c360 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:18.772 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:18.772 7faad446c360 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:18.772 7faad446c360 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:18.772 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:18.772 7faad446c360 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 01:59:18.772 7faad446c360 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:22.774 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:22.775 7faad446c360 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:22.775 7faad446c360 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:22.775 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:22.775 7faad446c360 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:22.775 7faad446c360 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:22.776 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:22.776 7faad446c360 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:22.776 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:22.776 7faad446c360 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:22.776 7faad446c360 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:22.776 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:22.776 7faad446c360 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 01:59:22.776 7faad446c360 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:26.778 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:26.779 7faad446c360 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:26.779 7faad446c360 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:26.779 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:26.779 7faad446c360 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:26.779 7faad446c360 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:26.779 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:26.780 7faad446c360 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:26.780 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:26.780 7faad446c360 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:26.780 7faad446c360 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:26.780 7faad446c360 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:26.780 7faad446c360 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 01:59:26.780 7faad446c360 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:30.781 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:30.782 7faad441c180 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:30.783 7faad441c180 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:30.783 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:30.783 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:30.783 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:30.783 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:30.783 7faad441c180 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:30.783 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:30.783 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:30.784 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:30.784 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:30.784 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 01:59:30.784 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:34.784 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:34.785 7faad441c180 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:34.785 7faad441c180 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:34.785 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:34.785 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:34.785 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:34.785 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:34.786 7faad441c180 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:34.786 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:34.786 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:34.786 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:34.786 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:34.786 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 01:59:34.786 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:38.786 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:38.787 7faad441c180 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:38.787 7faad441c180 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:38.787 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:38.788 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:38.788 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:38.788 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:38.788 7faad441c180 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:38.788 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:38.788 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:38.788 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:38.788 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:38.788 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 01:59:38.788 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:42.792 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:42.793 7faad441c180 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:42.793 7faad441c180 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:42.793 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:42.794 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:42.794 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:42.794 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:42.794 7faad441c180 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:42.794 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:42.794 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:42.794 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:42.794 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:42.794 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 01:59:42.794 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:46.797 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:46.798 7faad441c180 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:46.798 7faad441c180 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:46.798 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:46.798 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:46.798 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:46.798 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:46.799 7faad441c180 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:46.799 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:46.799 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:46.799 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:46.799 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:46.799 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 01:59:46.799 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:50.800 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:50.801 7faad441c180 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:50.801 7faad441c180 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:50.801 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:50.801 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:50.801 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:50.801 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:50.802 7faad441c180 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:50.802 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:50.802 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:50.802 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:50.802 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:50.802 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 01:59:50.802 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:54.803 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:54.804 7faad441c180 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:54.804 7faad441c180 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:54.804 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:54.804 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:54.804 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:54.804 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:54.805 7faad441c180 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:54.805 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:54.805 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:54.805 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:54.805 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:54.805 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 01:59:54.805 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:58.804 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:58.806 7faad441c180 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:58.806 7faad441c180 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:58.806 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:58.807 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:58.807 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:58.807 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:58.807 7faad441c180 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:58.807 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:58.807 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:58.807 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:58.807 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:58.807 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 01:59:58.807 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:02.811 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:02.812 7faad441c180 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:02.812 7faad441c180 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:02.813 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:02.813 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:02.813 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:02.813 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:02.813 7faad441c180 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:02.814 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:02.814 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:02.814 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:02.814 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:02.814 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:00:02.814 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:06.816 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:06.817 7faad441c180 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:06.817 7faad441c180 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:06.817 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:06.818 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:06.818 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:06.818 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:06.818 7faad441c180 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:06.818 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:06.818 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:06.818 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:06.818 7faad441c180 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:06.818 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:00:06.818 7faad441c180 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:10.818 7faad441c400 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:10.819 7faad441c400 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:10.819 7faad441c400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:10.819 7faad441c400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:10.819 7faad441c400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:10.819 7faad441c400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:10.819 7faad441c400 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:10.820 7faad441c400 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:10.820 7faad441c400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:10.820 7faad441c400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:10.820 7faad441c400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:10.820 7faad441c400 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:10.820 7faad441c400 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:00:10.820 7faad441c400 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:11.039 7faad441c180 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABotP4q6l38jXBkAYC40J3E_VV3v7FhJ80_5ymd5e5AHJUc1cu5L1AANq9Zn2PpFfGTSSkfuzV3rcRTrMpnsiIa4Ij2MeH5ZdpT6aTNej_mv95YoLbftLT9qR3GsAk6vZ7qikbwt-4qj84-XNXY8iH3uZSIz30KL9CjQVzReeiOqRvvx7Y 09/01/2025 02:00:11.039 7faad441c180 [contrail-analytics-api] [DEBUG]: user resources are None 09/01/2025 02:00:11.039 7faad441c180 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.38 object_type = vrouter request_url = http://10.0.0.131:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 452 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.32.5 node = cn-jenkins-deploy-platform-ansible-os-3995-3. >> 09/01/2025 02:00:14.820 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:14.821 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:14.822 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:14.822 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:14.822 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:14.822 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:14.822 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:14.822 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:14.822 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:14.822 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:14.822 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:14.822 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:14.823 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:00:14.823 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:18.822 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:18.823 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:18.823 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:18.823 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:18.824 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:18.824 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:18.824 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:18.824 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:18.824 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:18.824 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:18.824 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:18.825 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:18.825 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:00:18.825 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:22.826 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:22.828 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:22.828 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:22.828 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:22.828 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:22.828 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:22.828 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:22.829 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:22.829 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:22.829 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:22.829 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:22.829 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:22.829 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:00:22.829 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:26.832 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:26.833 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:26.833 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:26.833 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:26.833 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:26.833 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:26.833 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:26.833 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:26.833 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:26.834 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:26.834 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:26.834 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:26.834 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:00:26.834 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:30.833 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:30.835 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:30.835 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:30.835 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:30.835 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:30.835 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:30.835 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:30.836 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:30.836 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:30.836 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:30.836 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:30.836 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:30.836 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:00:30.836 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:34.837 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:34.838 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:34.838 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:34.838 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:34.838 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:34.838 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:34.838 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:34.839 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:34.839 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:34.839 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:34.839 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:34.839 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:34.839 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:00:34.839 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:38.838 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:38.840 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:38.840 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:38.840 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:38.840 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:38.840 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:38.840 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:38.840 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:38.841 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:38.841 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:38.841 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:38.841 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:38.841 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:00:38.841 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:42.844 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:42.846 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:42.846 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:42.846 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:42.846 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:42.846 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:42.847 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:42.847 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:42.847 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:42.847 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:42.847 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:42.847 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:42.848 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:00:42.848 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:46.847 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:46.849 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:46.849 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:46.849 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:46.849 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:46.849 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:46.849 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:46.850 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:46.850 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:46.850 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:46.850 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:46.850 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:46.850 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:00:46.850 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:50.850 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:50.851 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:50.852 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:50.852 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:50.852 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:50.852 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:50.852 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:50.852 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:50.852 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:50.853 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:50.853 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:50.853 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:50.853 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:00:50.853 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:54.853 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:54.855 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:54.855 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:54.855 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:54.855 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:54.855 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:54.855 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:54.856 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:54.856 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:54.856 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:54.856 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:54.856 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:54.856 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:00:54.856 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:58.856 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:58.857 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:58.857 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:58.857 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:58.858 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:58.858 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:58.858 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:58.858 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:58.858 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:58.858 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:58.858 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:58.858 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:58.859 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:00:58.859 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:02.859 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:02.860 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:02.860 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:02.860 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:02.860 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:02.861 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:02.861 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:02.861 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:02.861 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:02.861 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:02.861 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:02.861 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:02.861 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:01:02.861 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:06.864 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:06.866 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:06.866 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:06.866 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:06.866 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:06.866 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:06.867 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:06.867 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:06.867 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:06.867 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:06.868 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:06.868 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:06.868 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:01:06.868 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:10.867 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:10.868 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:10.869 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:10.869 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:10.869 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:10.869 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:10.869 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:10.869 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:10.869 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:10.870 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:10.870 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:10.870 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:10.870 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:01:10.870 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:14.870 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:14.872 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:14.872 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:14.872 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:14.872 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:14.872 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:14.872 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:14.872 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:14.873 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:14.873 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:14.873 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:14.873 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:14.873 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:01:14.873 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:18.872 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:18.873 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:18.873 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:18.873 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:18.873 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:18.873 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:18.873 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:18.874 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:18.874 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:18.874 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:18.874 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:18.874 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:18.874 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:01:18.874 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:22.874 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:22.875 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:22.875 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:22.876 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:22.876 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:22.876 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:22.876 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:22.876 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:22.876 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:22.876 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:22.876 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:22.876 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:22.876 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:01:22.876 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:26.879 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:26.880 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:26.880 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:26.880 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:26.880 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:26.881 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:26.881 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:26.881 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:26.881 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:26.881 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:26.881 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:26.881 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:26.881 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:01:26.881 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:30.883 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:30.884 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:30.884 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:30.884 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:30.884 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:30.884 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:30.884 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:30.885 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:30.885 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:30.885 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:30.885 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:30.885 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:30.885 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:01:30.885 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:34.886 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:34.887 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:34.887 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:34.887 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:34.887 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:34.887 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:34.887 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:34.888 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:34.888 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:34.888 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:34.888 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:34.888 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:34.888 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:01:34.888 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:38.888 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:38.889 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:38.889 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:38.889 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:38.889 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:38.889 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:38.889 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:38.889 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:38.890 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:38.890 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:38.890 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:38.890 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:38.890 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:01:38.890 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:42.893 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:42.894 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:42.895 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:42.895 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:42.895 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:42.895 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:42.895 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:42.895 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:42.895 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:42.895 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:42.896 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:42.896 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:42.896 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:01:42.896 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:46.896 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:46.897 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:46.897 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:46.897 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:46.897 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:46.897 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:46.897 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:46.898 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:46.898 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:46.898 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:46.898 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:46.898 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:46.898 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:01:46.898 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:50.899 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:50.900 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:50.901 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:50.901 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:50.901 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:50.901 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:50.901 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:50.901 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:50.901 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:50.902 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:50.902 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:50.902 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:50.902 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:01:50.902 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:54.902 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:54.904 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:54.904 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:54.904 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:54.904 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:54.904 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:54.904 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:54.904 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:54.904 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:54.905 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:54.905 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:54.905 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:54.905 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:01:54.905 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:58.904 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:58.905 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:58.906 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:58.906 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:58.906 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:58.906 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:58.906 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:58.906 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:58.906 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:58.906 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:58.907 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:58.907 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:58.907 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:01:58.907 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:02.907 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:02.908 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:02.908 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:02.908 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:02.908 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:02.908 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:02.908 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:02.909 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:02.909 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:02.909 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:02.909 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:02.909 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:02.909 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:02:02.909 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:05.488 7faad446c220 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 09/01/2025 02:02:05.736 7faad446c220 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 09/01/2025 02:02:05.982 7faad446c220 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 09/01/2025 02:02:06.512 7faad446c220 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 09/01/2025 02:02:06.575 7faad441c2c0 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 09/01/2025 02:02:06.908 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:06.910 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:06.910 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:06.910 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:06.910 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:06.910 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:06.910 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:06.911 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:06.911 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:06.911 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:06.911 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:06.911 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:06.911 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:02:06.911 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:08.520 7faad446c220 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 09/01/2025 02:02:10.599 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:02:10.911 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:10.912 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:10.912 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:10.912 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:10.912 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:10.912 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:10.913 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:10.913 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:10.913 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:10.913 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:10.913 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:10.913 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:10.913 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:02:10.913 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:12.167 7faad446c220 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABotP6k-FQCRwyuSp9haR5TJ2gVDtgzepnIR9Wus1i4lUHI4CeexaWqoBJdXt3VsP0lSMk9w3-aIizjp8YgBRiVcuCXrAFjpivsiORY80fcK0Z8RVizYrlAPBwz2AWKVPW-wcwlCLL7S8cNP7QCQAsokSLnUgttU0Yk3g_42IISdXgFB7M 09/01/2025 02:02:12.168 7faad446c220 [contrail-analytics-api] [DEBUG]: user resources are None 09/01/2025 02:02:12.168 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.38 object_type = vrouter request_url = http://10.0.0.131:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 597 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.32.5 node = cn-jenkins-deploy-platform-ansible-os-3995-3. >> 09/01/2025 02:02:14.914 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:14.915 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:14.915 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:14.915 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:14.915 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:14.915 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:14.915 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:14.916 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:14.916 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:14.916 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:14.916 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:14.916 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:14.916 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:02:14.916 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:18.916 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:18.917 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:18.917 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:18.917 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:18.917 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:18.917 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:18.918 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:18.918 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:18.918 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:18.918 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:18.918 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:18.918 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:18.918 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:02:18.918 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:22.833 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:02:22.918 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:22.919 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:22.919 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:22.920 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:22.920 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:22.920 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:22.920 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:22.920 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:22.920 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:22.920 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:22.920 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:22.920 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:22.920 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:02:22.921 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:26.922 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:26.923 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:26.923 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:26.923 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:26.923 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:26.923 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:26.923 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:26.923 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:26.924 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:26.924 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:26.924 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:26.924 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:26.924 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:02:26.924 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:30.925 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:30.927 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:30.927 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:30.927 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:30.927 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:30.927 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:30.927 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:30.928 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:30.928 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:30.928 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:30.928 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:30.928 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:30.928 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:02:30.928 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:34.929 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:34.930 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:34.930 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:34.930 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:34.930 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:34.931 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:34.931 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:34.931 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:34.931 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:34.931 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:34.931 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:34.931 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:34.931 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:02:34.931 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:35.090 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:02:38.931 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:38.933 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:38.933 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:38.933 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:38.933 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:38.933 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:38.933 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:38.933 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:38.933 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:38.934 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:38.934 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:38.934 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:38.934 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:02:38.934 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:42.935 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:42.936 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:42.936 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:42.936 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:42.936 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:42.936 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:42.936 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:42.937 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:42.937 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:42.937 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:42.937 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:42.937 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:42.937 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:02:42.937 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:46.940 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:46.941 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:46.941 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:46.941 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:46.941 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:46.941 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:46.941 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:46.942 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:46.942 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:46.942 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:46.942 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:46.942 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:46.942 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:02:46.942 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:47.164 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:02:50.944 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:50.945 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:50.945 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:50.945 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:50.945 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:50.945 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:50.945 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:50.945 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:50.945 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:50.946 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:50.946 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:50.946 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:50.946 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:02:50.946 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:54.945 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:54.947 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:54.947 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:54.947 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:54.947 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:54.947 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:54.947 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:54.948 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:54.948 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:54.948 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:54.948 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:54.948 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:54.948 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:02:54.948 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:58.947 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:58.949 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:58.949 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:58.949 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:58.949 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:58.949 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:58.949 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:58.949 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:58.949 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:58.950 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:58.950 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:58.950 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:58.950 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:02:58.950 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:59.166 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:03:02.953 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:02.955 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:02.955 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:02.955 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:02.955 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:02.955 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:02.956 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:02.956 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:02.956 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:02.956 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:02.956 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:02.956 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:02.956 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:03:02.956 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:06.958 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:06.959 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:06.959 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:06.959 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:06.959 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:06.959 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:06.959 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:06.960 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:06.960 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:06.960 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:06.960 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:06.960 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:06.960 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:03:06.960 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:10.962 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:10.963 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:10.964 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:10.964 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:10.964 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:10.964 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:10.964 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:10.964 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:10.964 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:10.965 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:10.965 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:10.965 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:10.965 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:03:10.965 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:11.451 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:03:13.339 7faad446c220 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABotP7hdKJ9AqiNnNkjToiL5JBjMFDwQwoTVhhDG5igrBc_PsEagHNIwjXnSW7laR3-ETMHI17JjM8TJMZ1RVfCbFyVNzW6IjF_3ADoo3gFTCUWw55vprXNhmpCh-AckmRzyPb7ORM4g8ZKAJoqf2Oph4fSlEGWfGp9EgG2bFP-a4UV_q0 09/01/2025 02:03:13.339 7faad446c220 [contrail-analytics-api] [DEBUG]: user resources are None 09/01/2025 02:03:13.339 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.38 object_type = vrouter request_url = http://10.0.0.131:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 486 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.32.5 node = cn-jenkins-deploy-platform-ansible-os-3995-3. >> 09/01/2025 02:03:14.965 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:14.966 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:14.967 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:14.967 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:14.967 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:14.967 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:14.967 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:14.967 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:14.967 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:14.967 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:14.967 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:14.968 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:14.968 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:03:14.968 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:18.967 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:18.969 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:18.969 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:18.969 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:18.969 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:18.969 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:18.969 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:18.970 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:18.970 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:18.970 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:18.970 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:18.970 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:18.970 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:03:18.970 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:22.970 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:22.971 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:22.971 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:22.971 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:22.972 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:22.972 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:22.972 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:22.972 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:22.972 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:22.972 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:22.972 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:22.972 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:22.972 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:03:22.973 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:23.505 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:03:26.975 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:26.976 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:26.976 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:26.976 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:26.976 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:26.976 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:26.976 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:26.977 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:26.977 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:26.977 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:26.977 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:26.977 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:26.977 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:03:26.977 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:30.978 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:30.980 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:30.980 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:30.980 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:30.980 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:30.980 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:30.980 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:30.980 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:30.980 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:30.981 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:30.981 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:30.981 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:30.981 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:03:30.981 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:34.982 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:34.983 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:34.983 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:34.983 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:34.983 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:34.983 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:34.983 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:34.984 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:34.984 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:34.984 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:34.984 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:34.984 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:34.984 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:03:34.984 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:35.716 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:03:38.984 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:38.985 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:38.985 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:38.985 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:38.985 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:38.985 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:38.985 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:38.986 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:38.986 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:38.986 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:38.986 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:38.986 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:38.986 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:03:38.986 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:42.990 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:42.991 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:42.991 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:42.991 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:42.991 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:42.991 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:42.991 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:42.992 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:42.992 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:42.992 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:42.992 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:42.992 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:42.992 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:03:42.992 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:46.992 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:46.993 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:46.993 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:46.993 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:46.994 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:46.994 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:46.994 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:46.994 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:46.994 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:46.994 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:46.994 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:46.994 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:46.994 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:03:46.994 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:47.891 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:03:50.995 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:50.997 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:50.997 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:50.997 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:50.997 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:50.997 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:50.997 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:50.998 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:50.998 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:50.998 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:50.998 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:50.998 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:50.998 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:03:50.998 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:54.998 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:55.000 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:55.000 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:55.000 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:55.000 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:55.000 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:55.000 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:55.000 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:55.001 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:55.001 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:55.001 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:55.001 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:55.001 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:03:55.001 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:59.001 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:59.002 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:59.002 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:59.002 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:59.002 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:59.002 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:59.002 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:59.003 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:59.003 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:59.003 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:59.003 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:59.003 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:59.003 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:03:59.003 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:59.940 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:04:03.005 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:03.006 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:03.007 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:03.007 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:03.007 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:03.007 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:03.007 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:03.007 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:03.007 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:03.007 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:03.007 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:03.008 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:03.008 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:04:03.008 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:07.009 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:07.010 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:07.010 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:07.011 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:07.011 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:07.011 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:07.011 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:07.011 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:07.011 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:07.011 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:07.012 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:07.012 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:07.012 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:04:07.012 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:11.013 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:11.015 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:11.015 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:11.015 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:11.016 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:11.016 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:11.016 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:11.016 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:11.016 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:11.016 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:11.016 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:11.016 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:11.016 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:04:11.017 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:12.227 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:04:15.017 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:15.018 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:15.018 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:15.018 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:15.018 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:15.018 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:15.019 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:15.019 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:15.019 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:15.019 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:15.019 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:15.019 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:15.019 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:04:15.019 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:19.019 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:19.020 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:19.020 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:19.020 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:19.021 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:19.021 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:19.021 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:19.021 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:19.021 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:19.021 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:19.021 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:19.021 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:19.021 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:04:19.021 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:23.025 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:23.026 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:23.026 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:23.026 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:23.026 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:23.026 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:23.026 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:23.027 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:23.027 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:23.027 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:23.027 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:23.027 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:23.027 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:04:23.027 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:24.265 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:04:27.027 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:27.028 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:27.028 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:27.028 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:27.028 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:27.028 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:27.028 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:27.029 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:27.029 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:27.029 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:27.029 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:27.029 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:27.029 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:04:27.029 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:31.031 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:31.032 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:31.032 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:31.032 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:31.032 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:31.032 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:31.032 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:31.033 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:31.033 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:31.033 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:31.033 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:31.033 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:31.033 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:04:31.033 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:35.034 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:35.035 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:35.036 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:35.036 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:35.036 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:35.036 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:35.036 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:35.036 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:35.036 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:35.036 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:35.036 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:35.037 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:35.037 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:04:35.037 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:36.590 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:04:39.036 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:39.037 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:39.037 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:39.037 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:39.037 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:39.037 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:39.037 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:39.038 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:39.038 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:39.038 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:39.038 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:39.038 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:39.038 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:04:39.038 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:43.042 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:43.043 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:43.043 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:43.043 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:43.043 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:43.043 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:43.043 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:43.044 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:43.044 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:43.044 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:43.044 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:43.044 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:43.044 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:04:43.044 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:47.046 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:47.047 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:47.047 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:47.048 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:47.048 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:47.048 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:47.048 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:47.048 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:47.049 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:47.049 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:47.049 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:47.049 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:47.049 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:04:47.049 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:48.999 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:04:51.050 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:51.051 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:51.052 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:51.052 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:51.052 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:51.052 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:51.052 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:51.052 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:51.052 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:51.053 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:51.053 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:51.053 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:51.053 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:04:51.053 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:55.053 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:55.055 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:55.055 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:55.055 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:55.055 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:55.055 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:55.055 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:55.056 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:55.056 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:55.056 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:55.056 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:55.056 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:55.056 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:04:55.056 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:59.056 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:59.057 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:59.057 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:59.057 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:59.058 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:59.058 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:59.058 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:59.058 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:59.058 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:59.058 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:59.058 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:59.058 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:59.059 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:04:59.059 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:01.067 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:05:03.059 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:03.060 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:03.061 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:03.061 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:03.061 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:03.061 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:03.061 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:03.061 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:03.061 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:03.061 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:03.061 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:03.061 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:03.062 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:05:03.062 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:07.062 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:07.064 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:07.064 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:07.064 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:07.064 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:07.064 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:07.064 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:07.064 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:07.064 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:07.065 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:07.065 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:07.065 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:07.065 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:05:07.065 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:11.065 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:11.066 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:11.067 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:11.067 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:11.067 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:11.067 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:11.067 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:11.068 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:11.068 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:11.068 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:11.068 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:11.068 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:11.068 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:05:11.068 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:13.719 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:05:14.646 7faad446c220 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABotP9aMQSuWx9PLBmbJWLI-0t5KtRWPQY1H2wlw2ggb0fBgchQ_sVs9Vf4Qn4JDV2MUyYXaUtJHhdwy3gQsLm1pJ8lm5yG5PBiV39YgoO-UPycqb1P-nSXuGVGZ-h4bORG6vFuUpDXpqrVtksk21ikIjhbGxjMS2QceTVXwDaK6GdhXGY 09/01/2025 02:05:14.646 7faad446c220 [contrail-analytics-api] [DEBUG]: user resources are None 09/01/2025 02:05:14.647 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.38 object_type = vrouter request_url = http://10.0.0.131:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 477 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.32.5 node = cn-jenkins-deploy-platform-ansible-os-3995-3. >> 09/01/2025 02:05:15.067 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:15.069 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:15.069 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:15.069 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:15.069 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:15.069 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:15.069 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:15.069 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:15.069 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:15.069 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:15.070 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:15.070 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:15.070 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:05:15.070 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:19.070 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:19.071 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:19.071 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:19.071 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:19.071 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:19.071 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:19.071 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:19.072 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:19.072 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:19.072 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:19.072 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:19.072 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:19.072 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:05:19.072 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:23.075 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:23.077 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:23.077 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:23.077 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:23.077 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:23.077 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:23.077 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:23.078 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:23.078 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:23.078 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:23.078 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:23.078 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:23.078 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:05:23.078 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:25.751 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:05:27.079 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:27.080 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:27.080 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:27.080 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:27.080 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:27.080 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:27.081 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:27.081 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:27.081 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:27.081 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:27.081 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:27.081 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:27.081 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:05:27.081 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:31.083 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:31.084 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:31.084 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:31.084 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:31.084 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:31.084 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:31.084 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:31.085 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:31.085 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:31.085 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:31.085 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:31.085 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:31.085 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:05:31.085 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:35.086 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:35.087 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:35.087 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:35.087 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:35.087 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:35.088 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:35.088 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:35.088 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:35.088 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:35.088 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:35.088 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:35.088 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:35.088 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:05:35.088 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:38.020 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:05:39.088 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:39.089 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:39.089 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:39.090 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:39.090 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:39.090 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:39.090 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:39.090 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:39.090 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:39.090 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:39.090 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:39.090 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:39.091 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:05:39.091 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:43.092 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:43.094 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:43.094 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:43.094 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:43.095 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:43.095 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:43.095 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:43.095 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:43.095 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:43.095 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:43.095 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:43.095 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:43.096 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:05:43.096 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:47.096 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:47.098 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:47.098 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:47.098 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:47.098 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:47.098 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:47.098 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:47.099 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:47.099 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:47.099 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:47.099 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:47.099 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:47.099 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:05:47.099 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:50.257 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:05:51.100 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:51.101 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:51.101 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:51.101 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:51.101 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:51.101 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:51.101 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:51.101 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:51.102 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:51.102 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:51.102 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:51.102 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:51.102 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:05:51.102 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:55.102 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:55.104 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:55.104 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:55.104 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:55.104 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:55.105 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:55.105 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:55.105 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:55.105 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:55.105 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:55.105 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:55.105 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:55.105 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:05:55.105 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:59.105 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:59.106 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:59.107 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:59.107 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:59.107 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:59.107 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:59.107 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:59.107 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:59.107 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:59.107 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:59.107 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:59.107 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:59.108 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:05:59.108 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:02.591 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:06:03.108 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:03.109 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:03.109 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:03.110 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:03.110 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:03.110 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:03.110 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:03.110 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:03.110 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:03.111 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:03.111 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:03.111 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:03.111 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:06:03.111 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:07.113 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:07.115 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:07.115 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:07.115 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:07.115 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:07.115 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:07.115 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:07.115 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:07.115 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:07.116 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:07.116 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:07.116 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:07.116 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:06:07.116 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:11.117 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:11.118 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:11.119 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:11.119 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:11.119 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:11.119 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:11.119 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:11.119 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:11.119 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:11.119 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:11.119 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:11.119 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:11.120 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:06:11.120 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:15.012 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:06:15.119 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:15.121 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:15.121 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:15.121 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:15.121 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:15.121 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:15.121 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:15.122 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:15.123 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:15.123 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:15.123 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:15.123 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:15.123 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:06:15.123 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:15.831 7faad446c220 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABotP-XkeUBpl4YiSo7bp9Kf2HFhKZIUDRKyauEHpXdIAY7nujBDnPWbc4jX6gdtdCNIm3LZjq33Rne0ZruHmry9mrl0CIYaXAa7Sl4_V5XY-yIxYh_bnHpe2sDiLsI5LiuGRnWSO8ZC-vocZfOfjt6VWCIUwGQIiBArwXyw7TSrGVAnPg 09/01/2025 02:06:15.831 7faad446c220 [contrail-analytics-api] [DEBUG]: user resources are None 09/01/2025 02:06:15.831 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.38 object_type = vrouter request_url = http://10.0.0.131:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 594 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.32.5 node = cn-jenkins-deploy-platform-ansible-os-3995-3. >> 09/01/2025 02:06:19.122 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:19.123 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:19.124 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:19.124 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:19.124 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:19.124 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:19.124 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:19.125 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:19.125 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:19.125 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:19.125 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:19.125 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:19.125 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:06:19.125 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:23.128 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:23.129 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:23.130 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:23.130 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:23.130 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:23.130 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:23.130 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:23.130 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:23.130 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:23.130 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:23.130 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:23.130 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:23.131 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:06:23.131 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:27.133 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:27.134 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:27.134 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:27.134 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:27.134 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:27.134 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:27.134 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:27.134 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:27.135 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:27.135 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:27.135 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:27.135 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:27.135 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:06:27.135 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:27.273 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:06:31.136 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:31.138 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:31.138 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:31.138 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:31.138 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:31.138 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:31.138 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:31.138 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:31.138 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:31.138 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:31.139 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:31.139 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:31.139 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:06:31.139 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:35.139 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:35.140 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:35.140 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:35.140 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:35.140 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:35.140 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:35.141 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:35.141 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:35.141 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:35.141 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:35.141 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:35.141 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:35.141 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:06:35.141 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:39.141 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:39.142 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:39.142 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:39.142 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:39.142 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:39.142 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:39.142 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:39.143 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:39.143 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:39.143 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:39.143 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:39.143 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:39.143 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:06:39.143 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:39.436 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:06:43.146 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:43.147 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:43.147 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:43.147 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:43.147 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:43.147 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:43.147 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:43.148 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:43.148 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:43.148 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:43.148 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:43.148 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:43.148 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:06:43.148 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:47.150 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:47.152 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:47.152 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:47.152 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:47.152 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:47.153 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:47.153 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:47.153 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:47.153 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:47.153 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:47.153 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:47.153 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:47.153 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:06:47.153 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:51.153 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:51.154 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:51.154 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:51.154 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:51.155 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:51.155 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:51.155 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:51.155 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:51.155 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:51.155 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:51.155 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:51.155 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:51.155 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:06:51.155 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:51.437 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:06:55.157 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:55.158 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:55.158 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:55.158 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:55.158 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:55.158 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:55.158 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:55.159 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:55.159 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:55.159 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:55.159 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:55.159 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:55.159 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:06:55.159 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:59.158 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:59.160 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:59.160 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:59.160 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:59.160 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:59.160 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:59.160 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:59.161 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:59.161 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:59.161 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:59.161 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:59.161 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:59.161 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:06:59.161 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:03.162 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:03.163 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:03.163 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:03.163 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:03.163 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:03.163 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:03.163 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:03.164 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:03.164 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:03.164 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:03.164 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:03.164 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:03.164 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:07:03.164 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:03.505 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:07:05.198 7faad446c220 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 09/01/2025 02:07:05.754 7faad446c220 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 09/01/2025 02:07:06.025 7faad446c220 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 09/01/2025 02:07:06.529 7faad446c220 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 09/01/2025 02:07:06.576 7faad441c180 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 09/01/2025 02:07:07.164 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:07.166 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:07.166 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:07.166 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:07.166 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:07.166 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:07.166 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:07.166 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:07.166 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:07.166 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:07.166 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:07.167 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:07.167 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:07:07.167 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:08.558 7faad446c220 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 09/01/2025 02:07:11.168 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:11.170 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:11.170 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:11.170 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:11.170 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:11.171 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:11.171 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:11.171 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:11.171 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:11.171 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:11.171 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:11.171 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:11.171 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:07:11.171 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:15.172 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:15.173 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:15.173 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:15.173 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:15.173 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:15.174 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:15.174 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:15.174 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:15.174 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:15.174 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:15.174 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:15.174 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:15.174 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:07:15.174 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:16.094 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:07:19.174 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:19.175 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:19.175 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:19.175 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:19.175 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:19.175 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:19.175 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:19.176 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:19.176 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:19.176 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:19.176 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:19.176 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:19.176 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:07:19.176 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:23.178 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:23.179 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:23.179 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:23.179 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:23.179 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:23.179 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:23.179 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:23.179 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:23.180 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:23.180 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:23.180 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:23.180 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:23.180 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:07:23.180 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:27.182 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:27.183 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:27.183 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:27.183 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:27.183 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:27.183 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:27.183 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:27.183 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:27.183 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:27.183 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:27.184 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:27.184 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:27.184 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:07:27.184 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:28.229 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:07:31.184 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:31.186 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:31.186 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:31.186 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:31.186 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:31.186 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:31.186 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:31.187 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:31.187 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:31.187 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:31.187 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:31.187 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:31.187 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:07:31.187 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:35.187 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:35.189 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:35.189 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:35.189 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:35.189 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:35.189 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:35.189 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:35.189 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:35.189 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:35.190 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:35.190 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:35.190 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:35.190 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:07:35.190 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:39.189 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:39.190 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:39.191 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:39.191 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:39.191 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:39.191 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:39.191 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:39.191 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:39.191 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:39.191 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:39.191 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:39.191 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:39.192 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:07:39.192 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:40.248 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:07:43.194 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:43.195 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:43.196 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:43.196 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:43.196 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:43.196 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:43.196 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:43.196 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:43.196 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:43.196 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:43.196 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:43.197 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:43.197 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:07:43.197 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:47.198 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:47.199 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:47.200 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:47.200 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:47.200 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:47.200 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:47.200 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:47.200 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:47.200 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:47.200 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:47.201 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:47.201 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:47.201 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:07:47.201 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:51.201 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:51.202 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:51.202 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:51.202 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:51.202 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:51.202 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:51.202 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:51.203 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:51.203 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:51.203 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:51.203 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:51.203 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:51.203 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:07:51.203 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:52.585 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:07:55.204 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:55.206 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:55.206 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:55.206 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:55.206 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:55.206 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:55.206 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:55.206 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:55.206 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:55.207 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:55.207 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:55.207 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:55.207 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:07:55.207 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:59.207 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:59.209 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:59.209 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:59.209 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:59.209 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:59.209 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:59.209 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:59.210 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:59.210 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:59.210 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:59.210 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:59.210 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:59.210 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:07:59.210 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:03.211 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:03.212 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:03.213 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:03.213 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:03.213 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:03.213 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:03.213 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:03.214 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:03.214 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:03.214 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:03.214 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:03.214 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:03.214 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:08:03.214 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:04.712 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:08:07.215 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:07.217 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:07.217 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:07.217 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:07.218 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:07.218 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:07.218 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:07.218 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:07.218 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:07.218 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:07.218 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:07.219 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:07.219 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:08:07.219 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:11.218 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:11.219 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:11.219 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:11.219 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:11.219 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:11.219 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:11.219 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:11.220 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:11.220 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:11.220 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:11.220 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:11.220 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:11.220 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:08:11.220 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:15.220 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:15.221 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:15.222 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:15.222 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:15.222 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:15.222 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:15.222 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:15.222 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:15.222 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:15.222 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:15.222 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:15.222 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:15.223 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:08:15.223 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:17.131 7faad446c220 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABotQARDZKL1wsUPxQiiJsJ9y_E-ba2LUUm8EY8H47SlF6RxeWrwSaE3wEJiPKzX8JvLxwWpFTCSobXEuk-lBfWNhhOrJyUbYfU9GRWTYx1F740FpsKb1L3k16RN1kBGk6P5oBcZoyWC6_hJqJgQFd8pDCttByyhzS9kb9Kd-NcozDAuUU 09/01/2025 02:08:17.131 7faad446c220 [contrail-analytics-api] [DEBUG]: user resources are None 09/01/2025 02:08:17.131 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.38 object_type = vrouter request_url = http://10.0.0.131:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 470 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.32.5 node = cn-jenkins-deploy-platform-ansible-os-3995-3. >> 09/01/2025 02:08:17.168 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:08:19.223 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:19.224 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:19.224 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:19.224 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:19.224 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:19.224 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:19.224 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:19.225 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:19.225 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:19.225 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:19.225 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:19.225 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:19.225 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:08:19.225 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:23.224 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:23.226 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:23.226 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:23.226 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:23.226 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:23.226 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:23.226 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:23.227 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:23.227 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:23.227 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:23.227 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:23.227 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:23.227 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:08:23.227 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:27.228 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:27.229 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:27.230 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:27.230 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:27.230 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:27.230 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:27.230 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:27.230 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:27.230 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:27.230 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:27.230 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:27.230 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:27.230 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:08:27.231 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:29.159 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:08:31.232 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:31.234 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:31.234 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:31.234 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:31.235 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:31.235 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:31.235 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:31.235 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:31.235 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:31.235 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:31.235 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:31.235 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:31.236 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:08:31.236 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:35.236 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:35.237 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:35.238 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:35.238 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:35.238 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:35.238 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:35.238 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:35.238 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:35.238 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:35.238 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:35.239 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:35.239 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:35.239 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:08:35.239 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:39.238 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:39.239 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:39.240 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:39.240 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:39.240 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:39.240 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:39.240 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:39.240 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:39.240 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:39.240 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:39.240 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:39.240 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:39.241 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:08:39.241 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:41.330 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:08:43.242 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:43.243 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:43.243 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:43.243 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:43.243 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:43.243 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:43.243 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:43.243 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:43.244 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:43.244 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:43.244 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:43.244 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:43.244 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:08:43.244 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:47.244 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:47.245 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:47.245 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:47.245 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:47.246 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:47.246 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:47.246 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:47.246 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:47.246 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:47.246 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:47.246 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:47.246 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:47.246 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:08:47.246 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:51.248 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:51.249 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:51.249 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:51.249 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:51.249 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:51.249 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:51.249 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:51.250 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:51.250 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:51.250 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:51.250 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:51.250 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:51.250 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:08:51.250 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:53.594 7faad446c220 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:08:55.250 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:55.251 7faad446c220 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:55.251 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:55.251 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:55.251 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:55.251 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:55.251 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:55.252 7faad446c220 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:55.252 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:55.252 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:55.252 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:55.252 7faad446c220 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:55.252 7faad446c220 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:08:55.252 7faad446c220 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:58.769 7faad441c2c0 [contrail-analytics-api] [DEBUG]: resource list for database-node is None 09/01/2025 02:08:58.770 7faad445d400 [contrail-analytics-api] [INFO]: db usage:{} 09/01/2025 02:08:58.772 7faad441c2c0 [contrail-analytics-api] [DEBUG]: resource list for database-node is None 09/01/2025 02:08:58.773 7faad445d400 [contrail-analytics-api] [INFO]: pending compaction tasks :{} 09/01/2025 02:08:59.252 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:59.253 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:59.254 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:59.254 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:59.254 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:59.254 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:59.254 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:59.254 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:59.255 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:59.255 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:59.255 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:59.255 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:59.255 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:08:59.255 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:03.256 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:03.257 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:03.257 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:03.257 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:03.257 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:03.257 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:03.257 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:03.257 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:03.257 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:03.258 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:03.258 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:03.258 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:03.258 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:09:03.258 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:05.622 7faad441c2c0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:09:07.258 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:07.259 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:07.259 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:07.259 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:07.259 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:07.259 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:07.259 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:07.260 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:07.260 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:07.260 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:07.260 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:07.260 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:07.260 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:09:07.260 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:11.262 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:11.263 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:11.264 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:11.264 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:11.264 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:11.264 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:11.264 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:11.264 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:11.264 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:11.264 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:11.264 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:11.264 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:11.265 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:09:11.265 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:15.264 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:15.265 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:15.265 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:15.265 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:15.265 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:15.265 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:15.265 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:15.266 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:15.266 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:15.266 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:15.266 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:15.266 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:15.266 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:09:15.266 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:17.946 7faad441c2c0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:09:18.305 7faad441c2c0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABotQBOCK-3uKxXnZhZavVbxuwJqMG9v44_UaTFteXrKHy5kW_k_gNXWbjNroS61HVGssR7XyKbh7zGPaI7ayKSkWpWTb_Z6yFRa0v13eFHm_p2j9lDjDMOgDzcUXaqMIwETLvTX7LwSeHOzgbOuTOr8xrUAgoyt12WPuzB5IaPs-hPvGw 09/01/2025 02:09:18.305 7faad441c2c0 [contrail-analytics-api] [DEBUG]: user resources are None 09/01/2025 02:09:18.306 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.38 object_type = vrouter request_url = http://10.0.0.131:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 440 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.32.5 node = cn-jenkins-deploy-platform-ansible-os-3995-3. >> 09/01/2025 02:09:19.265 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:19.267 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:19.267 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:19.267 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:19.267 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:19.267 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:19.267 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:19.267 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:19.267 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:19.267 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:19.268 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:19.268 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:19.268 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:09:19.268 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:23.271 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:23.272 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:23.272 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:23.272 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:23.273 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:23.273 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:23.273 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:23.273 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:23.273 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:23.273 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:23.273 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:23.273 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:23.273 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:09:23.273 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:27.275 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:27.276 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:27.276 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:27.276 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:27.277 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:27.277 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:27.277 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:27.277 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:27.277 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:27.277 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:27.277 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:27.277 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:27.278 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:09:27.278 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:29.982 7faad441c2c0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:09:31.278 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:31.279 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:31.279 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:31.279 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:31.279 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:31.279 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:31.279 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:31.279 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:31.280 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:31.280 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:31.280 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:31.280 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:31.280 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:09:31.280 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:35.281 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:35.283 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:35.283 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:35.283 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:35.283 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:35.283 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:35.283 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:35.283 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:35.283 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:35.284 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:35.284 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:35.284 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:35.284 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:09:35.284 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:39.284 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:39.285 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:39.285 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:39.285 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:39.285 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:39.286 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:39.286 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:39.286 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:39.286 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:39.286 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:39.286 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:39.286 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:39.286 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:09:39.286 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:42.091 7faad441c2c0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:09:43.287 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:43.288 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:43.288 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:43.289 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:43.289 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:43.289 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:43.289 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:43.289 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:43.289 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:43.289 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:43.289 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:43.289 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:43.290 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:09:43.290 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:47.290 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:47.291 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:47.291 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:47.291 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:47.291 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:47.291 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:47.291 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:47.291 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:47.292 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:47.292 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:47.292 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:47.292 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:47.292 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:09:47.292 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:51.294 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:51.295 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:51.295 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:51.295 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:51.295 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:51.295 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:51.296 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:51.296 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:51.296 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:51.296 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:51.296 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:51.296 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:51.296 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:09:51.296 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:54.330 7faad441c2c0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:09:55.295 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:55.296 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:55.297 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:55.297 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:55.297 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:55.297 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:55.297 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:55.297 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:55.297 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:55.297 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:55.297 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:55.297 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:55.298 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:09:55.298 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:59.298 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:59.299 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:59.299 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:59.299 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:59.299 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:59.299 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:59.299 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:59.300 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:59.300 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:59.300 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:59.300 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:59.300 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:59.300 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:09:59.300 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:03.303 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:03.304 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:03.304 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:03.304 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:03.305 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:03.305 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:03.305 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:03.305 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:03.305 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:03.305 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:03.305 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:03.305 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:03.305 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:10:03.305 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:06.586 7faad441c2c0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:10:07.305 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:07.306 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:07.306 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:07.306 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:07.306 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:07.306 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:07.307 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:07.307 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:07.307 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:07.307 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:07.307 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:07.307 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:07.307 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:10:07.307 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:11.307 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:11.308 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:11.309 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:11.309 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:11.309 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:11.309 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:11.309 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:11.309 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:11.310 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:11.310 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:11.310 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:11.310 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:11.310 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:10:11.310 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:15.310 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:15.311 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:15.311 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:15.311 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:15.311 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:15.311 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:15.312 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:15.312 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:15.312 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:15.312 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:15.312 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:15.312 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:15.312 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:10:15.312 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:19.102 7faad441c2c0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:10:19.312 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:19.314 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:19.314 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:19.314 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:19.314 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:19.314 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:19.314 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:19.315 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:19.315 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:19.315 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:19.316 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:19.316 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:19.316 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:10:19.316 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:23.316 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:23.318 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:23.318 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:23.318 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:23.318 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:23.318 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:23.318 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:23.319 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:23.319 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:23.319 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:23.319 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:23.319 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:23.319 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:10:23.319 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:27.318 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:27.319 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:27.320 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:27.320 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:27.320 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:27.320 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:27.320 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:27.320 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:27.320 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:27.321 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:27.321 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:27.321 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:27.321 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:10:27.321 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:31.218 7faad441c2c0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:10:31.320 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:31.321 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:31.322 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:31.322 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:31.322 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:31.322 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:31.322 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:31.322 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:31.322 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:31.322 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:31.323 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:31.323 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:31.323 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:10:31.323 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:35.323 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:35.324 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:35.324 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:35.324 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:35.325 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:35.325 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:35.325 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:35.325 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:35.325 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:35.325 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:35.325 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:35.325 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:35.325 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:10:35.326 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:39.325 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:39.326 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:39.326 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:39.326 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:39.326 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:39.326 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:39.326 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:39.327 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:39.327 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:39.327 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:39.327 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:39.327 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:39.327 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:10:39.327 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:43.330 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:43.331 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:43.332 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:43.332 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:43.332 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:43.332 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:43.332 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:43.332 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:43.332 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:43.332 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:43.333 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:43.333 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:43.333 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:10:43.333 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:43.659 7faad441c2c0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:10:47.335 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:47.337 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:47.337 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:47.337 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:47.337 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:47.337 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:47.337 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:47.338 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:47.338 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:47.338 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:47.338 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:47.338 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:47.338 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:10:47.338 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:51.340 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:51.341 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:51.341 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:51.341 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:51.342 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:51.342 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:51.342 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:51.342 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:51.342 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:51.342 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:51.342 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:51.342 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:51.342 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:10:51.342 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:55.342 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:55.343 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:55.344 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:55.344 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:55.344 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:55.344 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:55.344 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:55.344 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:55.344 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:55.344 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:55.345 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:55.345 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:55.345 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:10:55.345 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:55.742 7faad441c2c0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:10:59.344 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:59.346 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:59.346 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:59.346 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:59.346 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:59.346 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:59.346 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:59.347 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:59.347 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:59.347 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:59.347 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:59.347 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:59.347 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:10:59.347 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:03.348 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:03.349 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:03.350 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:03.350 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:03.350 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:03.350 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:03.350 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:03.351 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:03.351 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:03.351 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:03.351 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:03.351 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:03.352 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:11:03.352 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:07.353 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:07.355 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:07.355 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:07.355 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:07.355 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:07.355 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:07.355 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:07.355 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:07.355 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:07.356 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:07.356 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:07.356 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:07.356 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:11:07.356 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:08.087 7faad441c2c0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:11:11.358 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:11.359 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:11.359 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:11.359 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:11.359 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:11.359 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:11.359 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:11.360 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:11.360 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:11.360 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:11.360 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:11.360 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:11.360 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:11:11.360 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:15.361 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:15.362 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:15.362 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:15.362 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:15.362 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:15.362 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:15.362 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:15.363 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:15.363 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:15.363 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:15.363 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:15.363 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:15.363 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:11:15.363 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:19.362 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:19.364 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:19.364 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:19.364 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:19.364 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:19.364 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:19.364 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:19.365 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:19.365 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:19.365 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:19.365 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:19.365 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:19.365 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:11:19.365 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:19.623 7faad441c2c0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABotQDH3nMsrj_au-RZ8BRu3tE73iWNr9IloRMqv_WBHiLbjnPIziIqITDJKs1s1RsSQ-7nAouK19imF8pEhmlPCsm5odwDOyaIhWqWI5D5C4U6pGKoaV5623rkdhLAkpNB-A3lxv8YmHnvWxwwul_J3HewU5rKjfQS8XKW9Uqd3hFQnTw 09/01/2025 02:11:19.623 7faad441c2c0 [contrail-analytics-api] [DEBUG]: user resources are None 09/01/2025 02:11:19.624 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.38 object_type = vrouter request_url = http://10.0.0.131:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 460 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.32.5 node = cn-jenkins-deploy-platform-ansible-os-3995-3. >> 09/01/2025 02:11:20.534 7faad441c2c0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:11:23.366 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:23.367 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:23.367 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:23.367 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:23.367 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:23.367 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:23.367 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:23.368 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:23.368 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:23.368 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:23.368 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:23.368 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:23.368 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:11:23.368 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:27.369 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:27.370 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:27.370 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:27.370 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:27.370 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:27.370 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:27.370 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:27.370 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:27.370 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:27.371 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:27.371 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:27.371 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:27.371 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:11:27.371 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:31.372 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:31.373 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:31.373 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:31.374 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:31.374 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:31.374 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:31.374 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:31.374 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:31.374 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:31.374 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:31.374 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:31.374 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:31.374 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:11:31.375 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:32.791 7faad441c2c0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:11:35.376 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:35.377 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:35.377 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:35.377 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:35.377 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:35.377 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:35.377 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:35.378 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:35.378 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:35.378 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:35.378 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:35.378 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:35.378 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:11:35.378 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:39.377 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:39.378 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:39.378 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:39.379 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:39.379 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:39.379 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:39.379 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:39.379 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:39.379 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:39.379 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:39.379 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:39.379 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:39.380 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:11:39.380 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:43.383 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:43.385 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:43.385 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:43.385 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:43.385 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:43.385 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:43.385 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:43.385 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:43.385 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:43.386 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:43.386 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:43.386 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:43.386 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:11:43.386 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:44.997 7faad441c2c0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:11:47.387 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:47.388 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:47.388 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:47.389 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:47.389 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:47.389 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:47.389 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:47.389 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:47.389 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:47.389 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:47.389 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:47.389 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:47.390 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:11:47.390 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:51.390 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:51.390 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:51.391 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:51.391 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:51.391 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:51.391 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:51.391 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:51.391 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:51.391 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:51.391 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:51.391 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:51.391 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:51.392 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:11:51.392 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:55.392 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:55.393 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:55.393 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:55.393 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:55.394 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:55.394 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:55.394 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:55.394 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:55.394 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:55.394 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:55.394 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:55.394 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:55.394 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:11:55.394 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:57.008 7faad441c2c0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:11:59.394 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:59.396 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:59.396 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:59.396 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:59.396 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:59.396 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:59.396 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:59.396 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:59.397 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:59.397 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:59.397 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:59.397 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:59.397 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:11:59.397 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:03.400 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:03.402 7faad441c2c0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:03.402 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:03.402 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:03.402 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:03.402 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:03.402 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:03.402 7faad441c2c0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:03.402 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:03.403 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:03.403 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:03.403 7faad441c2c0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:03.403 7faad441c2c0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:12:03.403 7faad441c2c0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:05.227 7faad441c2c0 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 09/01/2025 02:12:05.751 7faad441c2c0 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 09/01/2025 02:12:05.987 7faad441c2c0 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 09/01/2025 02:12:06.565 7faad441c2c0 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 09/01/2025 02:12:06.627 7faad441c900 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 09/01/2025 02:12:07.403 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:07.404 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:07.405 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:07.405 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:07.405 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:07.405 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:07.405 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:07.405 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:07.406 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:07.406 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:07.406 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:07.406 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:07.406 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:12:07.406 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:08.614 7faad441c900 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 09/01/2025 02:12:09.326 7faad441c900 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:12:11.406 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:11.407 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:11.407 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:11.408 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:11.408 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:11.408 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:11.408 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:11.408 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:11.408 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:11.408 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:11.409 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:11.409 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:11.409 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:12:11.409 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:15.408 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:15.409 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:15.410 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:15.410 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:15.410 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:15.410 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:15.410 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:15.410 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:15.410 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:15.410 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:15.410 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:15.410 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:15.411 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:12:15.411 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:19.411 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:19.412 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:19.412 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:19.412 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:19.413 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:19.413 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:19.413 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:19.413 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:19.413 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:19.413 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:19.413 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:19.413 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:19.413 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:12:19.414 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:20.829 7faad441c900 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABotQEEkI8EdL8WCUb7NNzfVjFRiXXchRvDhyi7kmSoQgj-GpQ2BJ_TSPT0Uqh-DK0s3jZL4rH1KfkR8OA7L4PDgwPo63rqY6JnUTOqw4n1kJgx3jI_YbxEho8ZMhf_2iBpchPQJm9AMNN51bhj7qEIm_9ZwwZOnuXlZAQ8k6_7vVMmuUE 09/01/2025 02:12:20.829 7faad441c900 [contrail-analytics-api] [DEBUG]: user resources are None 09/01/2025 02:12:20.830 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.38 object_type = vrouter request_url = http://10.0.0.131:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 521 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.32.5 node = cn-jenkins-deploy-platform-ansible-os-3995-3. >> 09/01/2025 02:12:21.882 7faad441c900 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:12:23.414 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:23.415 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:23.415 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:23.415 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:23.415 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:23.415 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:23.415 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:23.416 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:23.416 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:23.416 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:23.416 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:23.416 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:23.416 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:12:23.416 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:27.418 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:27.419 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:27.419 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:27.419 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:27.420 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:27.420 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:27.420 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:27.420 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:27.420 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:27.420 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:27.420 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:27.420 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:27.420 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:12:27.420 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:31.422 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:31.424 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:31.424 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:31.424 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:31.424 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:31.424 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:31.424 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:31.424 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:31.424 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:31.425 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:31.425 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:31.425 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:31.425 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:12:31.425 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:33.936 7faad441c900 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:12:35.426 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:35.427 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:35.427 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:35.427 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:35.427 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:35.427 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:35.427 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:35.428 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:35.428 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:35.428 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:35.428 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:35.428 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:35.428 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:12:35.428 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:39.428 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:39.430 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:39.430 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:39.430 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:39.430 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:39.430 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:39.430 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:39.431 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:39.431 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:39.431 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:39.431 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:39.431 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:39.431 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:12:39.431 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:43.434 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:43.435 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:43.435 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:43.435 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:43.435 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:43.435 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:43.435 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:43.436 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:43.436 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:43.436 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:43.436 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:43.436 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:43.436 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:12:43.436 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:46.052 7faad441c900 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:12:47.437 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:47.438 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:47.438 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:47.438 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:47.438 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:47.438 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:47.438 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:47.439 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:47.439 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:47.439 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:47.439 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:47.439 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:47.439 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:12:47.439 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:51.441 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:51.442 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:51.442 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:51.442 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:51.442 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:51.442 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:51.442 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:51.443 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:51.443 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:51.443 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:51.443 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:51.443 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:51.443 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:12:51.443 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:55.444 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:55.446 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:55.446 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:55.446 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:55.446 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:55.446 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:55.446 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:55.447 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:55.447 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:55.447 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:55.447 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:55.447 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:55.447 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:12:55.447 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:58.330 7faad441c900 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:12:59.447 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:59.448 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:59.448 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:59.448 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:59.449 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:59.449 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:59.449 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:59.449 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:59.449 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:59.449 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:59.449 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:59.449 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:59.449 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:12:59.449 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:03.453 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:03.454 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:03.454 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:03.454 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:03.455 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:03.455 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:03.455 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:03.455 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:03.455 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:03.455 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:03.455 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:03.455 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:03.456 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:13:03.456 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:07.458 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:07.460 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:07.460 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:07.460 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:07.460 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:07.460 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:07.460 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:07.461 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:07.461 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:07.461 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:07.461 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:07.461 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:07.461 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:13:07.461 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:10.558 7faad441c900 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:13:11.461 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:11.463 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:11.463 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:11.463 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:11.463 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:11.463 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:11.463 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:11.463 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:11.463 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:11.463 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:11.463 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:11.464 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:11.464 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:13:11.464 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:15.464 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:15.465 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:15.466 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:15.466 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:15.466 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:15.466 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:15.466 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:15.466 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:15.466 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:15.467 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:15.467 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:15.467 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:15.467 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:13:15.467 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:19.466 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:19.467 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:19.468 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:19.468 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:19.468 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:19.468 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:19.468 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:19.468 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:19.468 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:19.468 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:19.468 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:19.468 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:19.469 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:13:19.469 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:23.119 7faad441c900 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:13:23.468 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:23.469 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:23.469 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:23.469 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:23.469 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:23.469 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:23.469 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:23.470 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:23.470 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:23.470 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:23.470 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:23.470 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:23.470 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:13:23.470 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:27.472 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:27.473 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:27.473 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:27.473 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:27.474 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:27.474 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:27.474 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:27.474 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:27.474 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:27.474 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:27.474 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:27.474 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:27.474 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:13:27.475 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:31.474 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:31.475 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:31.475 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:31.475 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:31.476 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:31.476 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:31.476 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:31.476 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:31.476 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:31.476 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:31.476 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:31.476 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:31.476 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:13:31.476 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:35.305 7faad441c900 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:13:35.475 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:35.477 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:35.477 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:35.477 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:35.477 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:35.477 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:35.477 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:35.477 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:35.477 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:35.478 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:35.478 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:35.478 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:35.478 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:13:35.478 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:39.478 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:39.480 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:39.480 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:39.480 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:39.480 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:39.480 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:39.480 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:39.480 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:39.481 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:39.481 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:39.481 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:39.481 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:39.481 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:13:39.481 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:43.482 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:43.483 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:43.483 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:43.483 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:43.483 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:43.483 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:43.483 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:43.484 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:43.484 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:43.484 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:43.484 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:43.484 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:43.484 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:13:43.484 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:47.486 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:47.487 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:47.487 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:47.487 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:47.487 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:47.487 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:47.488 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:47.488 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:47.488 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:47.488 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:47.488 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:47.488 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:47.488 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:13:47.488 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:47.581 7faad441c900 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:13:51.488 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:51.489 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:51.489 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:51.489 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:51.489 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:51.489 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:51.489 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:51.490 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:51.490 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:51.490 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:51.490 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:51.490 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:51.490 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:13:51.490 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:55.491 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:55.492 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:55.492 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:55.492 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:55.492 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:55.492 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:55.492 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:55.493 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:55.493 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:55.493 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:55.493 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:55.493 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:55.493 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:13:55.493 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:59.493 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:59.494 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:59.494 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:59.494 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:59.494 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:59.494 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:59.494 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:59.494 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:59.494 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:59.495 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:59.495 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:59.495 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:59.495 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:13:59.495 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:59.634 7faad441c900 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:14:03.498 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:03.499 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:03.499 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:03.499 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:03.499 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:03.499 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:03.499 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:03.499 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:03.499 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:03.499 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:03.499 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:03.500 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:03.500 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:14:03.500 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:07.502 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:07.503 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:07.503 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:07.503 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:07.503 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:07.503 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:07.503 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:07.503 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:07.504 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:07.504 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:07.504 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:07.504 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:07.504 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:14:07.504 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:11.504 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:11.505 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:11.506 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:11.506 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:11.506 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:11.506 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:11.506 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:11.506 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:11.506 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:11.506 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:11.506 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:11.506 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:11.507 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:14:11.507 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:11.603 7faad441c900 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:14:15.508 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:15.509 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:15.509 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:15.510 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:15.510 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:15.510 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:15.510 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:15.510 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:15.510 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:15.510 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:15.510 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:15.510 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:15.511 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:14:15.511 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:19.511 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:19.512 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:19.512 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:19.512 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:19.512 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:19.512 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:19.512 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:19.513 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:19.513 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:19.513 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:19.513 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:19.513 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:19.513 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:14:19.513 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:22.131 7faad441c900 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABotQF-OSzykAQOjq8IvZKJXd_022mz0VzA6QbIanzCQ3ucQb_Xn9hKxQMmz4USkCSVYdTQbxlzuTmlHJKjZW_hAf2ahngTPV2Qbe7GqX9wmBxUkx78ldVurLhgVGlteIwdyJF_7T8cCO769rJpWhVxfptH7bNTpLzdF7QBKnF5RQ2C3Ic 09/01/2025 02:14:22.131 7faad441c900 [contrail-analytics-api] [DEBUG]: user resources are None 09/01/2025 02:14:22.132 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.38 object_type = vrouter request_url = http://10.0.0.131:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 455 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.32.5 node = cn-jenkins-deploy-platform-ansible-os-3995-3. >> 09/01/2025 02:14:23.514 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:23.515 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:23.515 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:23.515 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:23.515 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:23.515 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:23.515 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:23.516 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:23.516 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:23.516 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:23.516 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:23.516 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:23.516 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:14:23.516 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:24.170 7faad441c900 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:14:26.181 7faad441c900 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:14:27.516 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:27.517 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:27.518 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:27.518 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:27.518 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:27.518 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:27.518 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:27.518 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:27.518 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:27.518 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:27.518 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:27.518 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:27.519 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:14:27.519 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:28.179 7faad441c900 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:14:31.519 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:31.520 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:31.520 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:31.520 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:31.521 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:31.521 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:31.521 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:31.521 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:31.521 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:31.521 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:31.521 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:31.521 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:31.521 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:14:31.521 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:35.522 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:35.523 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:35.523 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:35.523 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:35.523 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:35.523 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:35.523 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:35.524 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:35.524 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:35.524 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:35.524 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:35.524 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:35.524 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:14:35.524 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:39.524 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:39.605 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:39.605 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:39.605 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:39.605 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:39.605 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:39.605 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:39.606 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:39.606 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:39.606 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:39.606 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:39.606 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:39.606 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:14:39.606 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:43.606 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:43.607 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:43.607 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:43.607 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:43.608 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:43.608 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:43.608 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:43.608 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:43.608 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:43.608 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:43.608 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:43.608 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:43.608 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:14:43.608 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:45.783 7faad441c900 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 09/01/2025 02:14:47.609 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:47.610 7faad441c900 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:47.610 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:47.611 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:47.611 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:47.611 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:47.611 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:47.611 7faad441c900 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:47.611 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:47.611 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.249:6379, 10.0.0.38:6379, 10.0.0.131:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.249:2181, 10.0.0.38:2181, 10.0.0.131:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249:8082, 10.0.0.38:8082, 10.0.0.131:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:47.611 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:47.611 7faad441c900 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:47.611 7faad441c900 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3995-3.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1756691938757009 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.38:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 09/01/2025 02:14:47.612 7faad441c900 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]