06/02/2025 02:07:15.290 7fe937fad508 [contrail-analytics-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 06/02/2025 02:07:15.290 7fe937fad508 [contrail-analytics-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 06/02/2025 02:07:15.290 7fe937fad508 [contrail-analytics-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 06/02/2025 02:07:15.297 7fe937fad508 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:07:15.396 7fe937fad508 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 06/02/2025 02:07:15.399 7fe930326438 [contrail-analytics-api] [ERROR]: Cannot write http_port 8090 to /tmp/contrail-analytics-api.0.http_port 06/02/2025 02:07:15.399 7fe930326438 [contrail-analytics-api] [ERROR]: Starting Introspect on HTTP Port 8090 06/02/2025 02:07:15.400 7fe930327d68 [contrail-analytics-api] [INFO]: Processing event[EvStart] in state[none] 06/02/2025 02:07:15.407 7fe930327d68 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 06/02/2025 02:07:15.408 7fe930327d68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 06/02/2025 02:07:15.408 7fe930327d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:15.408 7fe930327d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, ] description = >>, ] >> 06/02/2025 02:07:15.408 7fe930327d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:15.408 7fe930327d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:15.408 7fe930327d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Initializing description = Redis Instance initialized >>, ] description = Redis-UVE:10.0.0.129:6379[Redis Instance initialized] connection down >>, ] >> 06/02/2025 02:07:15.408 7fe930327d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:15.409 7fe930327d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:15.409 7fe930327d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, ] description = Redis-UVE:10.0.0.129:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized] connection down >>, ] >> 06/02/2025 02:07:15.409 7fe930327d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:15.409 7fe930327d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:15.409 7fe930327d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] AnalyticsApiInfoUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 analytics_node_ip = { rest_api_ip : 10.0.0.129host_ip : 10.0.0.129 } >> 06/02/2025 02:07:15.409 7fe930327d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:15.409 7fe930327d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:15.410 7fe930327d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Redis-UVE:10.0.0.129:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 06/02/2025 02:07:15.410 7fe930327d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:15.410 7fe930327d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:15.410 7fe930327d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 5 max_sm_queue_count = 5 >> 06/02/2025 02:07:15.410 7fe930327d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:15.413 7fe935cadc18 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 06/02/2025 02:07:15.427 7fe936770978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:15.429 7fe936770978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Redis-UVE:10.0.0.129:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 06/02/2025 02:07:15.431 7fe936770978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:15.496 7fe93469eb70 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:15.515 7fe93469eb70 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Down description = >>, ] description = Redis-UVE:10.0.0.129:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[] connection down >>, ] >> 06/02/2025 02:07:15.515 7fe93469eb70 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:15.516 7fe934700a20 [contrail-analytics-api] [INFO]: Analytics Discovery listen CONNECTED 06/02/2025 02:07:15.516 7fe934700a20 [contrail-analytics-api] [INFO]: Analytics Discovery to publish None 06/02/2025 02:07:15.516 7fe93469eb70 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:15.519 7fe93469eb70 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Down description = >>, ] description = Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[] connection down >>, ] >> 06/02/2025 02:07:15.520 7fe93469eb70 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:15.520 7fe93469eb70 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:15.520 7fe93469eb70 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper re-established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[] connection down >>, ] >> 06/02/2025 02:07:15.520 7fe93469eb70 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:15.520 7fe93469ed68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:15.521 7fe93469ed68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[] connection down >>, ] >> 06/02/2025 02:07:15.527 7fe93469ed68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:15.546 7fe935cadc18 [contrail-analytics-api] [INFO]: Analytics Discovery Watcher AlarmGenerator Children [] 06/02/2025 02:07:15.554 7fe935cadc18 [contrail-analytics-api] [INFO]: Analytics Discovery OpServer reconnect 06/02/2025 02:07:15.554 7fe935cadc18 [contrail-analytics-api] [INFO]: ensure /analytics-discovery-/OpServer 06/02/2025 02:07:15.554 7fe935cadc18 [contrail-analytics-api] [INFO]: zk state CONNECTED (CONNECTED) 06/02/2025 02:07:15.569 7fe935cadc18 [contrail-analytics-api] [INFO]: check for /analytics-discovery-/OpServer/cn-jenkins-deploy-platform-juju-os-542-1-0 06/02/2025 02:07:18.421 7fe936b55e10 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:07:19.409 7fe9345c6e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:07:24.414 7fe9345c6e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:07:24.414 7fe9345c6e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:07:24.414 7fe9345c6e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:24.415 7fe9345c6e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 06/02/2025 02:07:24.415 7fe9345c6e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:24.415 7fe9345c6e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:07:24.415 7fe9345c6e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:07:24.416 7fe9345c6e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:24.416 7fe9345c6e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[] connection down >>, ] >> 06/02/2025 02:07:24.416 7fe9345c6e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:24.416 7fe9345c6e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:24.416 7fe9345c6e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:07:24.416 7fe9345c6e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:28.414 7fe933e56240 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:07:30.617 7fe9347008d0 [contrail-analytics-api] [INFO]: Analytics Discovery Watcher AlarmGenerator Children ['cn-jenkins-deploy-platform-juju-os-542-1-0'] 06/02/2025 02:07:33.429 7fe933e56240 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:07:33.429 7fe933e56240 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:07:33.429 7fe933e56240 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:33.429 7fe933e56240 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 06/02/2025 02:07:33.429 7fe933e56240 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:33.429 7fe933e56240 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:07:33.430 7fe933e56240 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:07:33.430 7fe933e56240 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:33.430 7fe933e56240 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[] connection down >>, ] >> 06/02/2025 02:07:33.430 7fe933e56240 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:33.430 7fe933e56240 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:33.431 7fe933e56240 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:07:33.431 7fe933e56240 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:35.581 7fe935cadc18 [contrail-analytics-api] [INFO]: Analytics Discovery OpServer reconnect 06/02/2025 02:07:35.581 7fe935cadc18 [contrail-analytics-api] [INFO]: ensure /analytics-discovery-/OpServer 06/02/2025 02:07:35.581 7fe935cadc18 [contrail-analytics-api] [INFO]: zk state CONNECTED (CONNECTED) 06/02/2025 02:07:35.583 7fe935cadc18 [contrail-analytics-api] [INFO]: check for /analytics-discovery-/OpServer/cn-jenkins-deploy-platform-juju-os-542-1-0 06/02/2025 02:07:35.595 7fe935cadc18 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-juju-os-542-1-0, data b'{"ip-address": "10.0.0.129", "instance-id": "0", "redis-ip": "10.0.0.129", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{}"}', event None 06/02/2025 02:07:35.598 7fe935cadc18 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-juju-os-542-1-0, data OrderedDict([('instance-id', '0'), ('ip-address', '10.0.0.129'), ('partitions', '{}'), ('redis-agg-db', 7), ('redis-ip', '10.0.0.129'), ('redis-port', '6379')]), event GET 06/02/2025 02:07:37.429 7fe934674198 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:07:39.767 7fe9347008d0 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-juju-os-542-1-0, data b'{"ip-address": "10.0.0.129", "instance-id": "0", "redis-ip": "10.0.0.129", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{}"}', event WatchedEvent(type='CHANGED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-juju-os-542-1-0') 06/02/2025 02:07:40.596 7fe9347008d0 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-juju-os-542-1-0, data b'{"ip-address": "10.0.0.129", "instance-id": "0", "redis-ip": "10.0.0.129", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{\\"0\\": 1748830060350161, \\"1\\": 1748830060363015, \\"2\\": 1748830060393532, \\"3\\": 1748830060419550, \\"4\\": 1748830060438758, \\"5\\": 1748830060476120}"}', event WatchedEvent(type='CHANGED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-juju-os-542-1-0') 06/02/2025 02:07:40.932 7fe9367d2a20 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:07:41.774 7fe9347008d0 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-juju-os-542-1-0, data b'{"ip-address": "10.0.0.129", "instance-id": "0", "redis-ip": "10.0.0.129", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{\\"0\\": 1748830060350161, \\"1\\": 1748830060363015, \\"2\\": 1748830060393532, \\"3\\": 1748830060419550, \\"4\\": 1748830060438758, \\"5\\": 1748830060476120, \\"6\\": 1748830060507115, \\"7\\": 1748830060549367, \\"8\\": 1748830060591511, \\"9\\": 1748830060646541, \\"10\\": 1748830060707181, \\"11\\": 1748830060741449, \\"12\\": 1748830060794167, \\"13\\": 1748830060842604, \\"14\\": 1748830060908822, \\"15\\": 1748830060959020, \\"16\\": 1748830060999907, \\"17\\": 1748830061057368, \\"18\\": 1748830061104403, \\"20\\": 1748830061162452, \\"21\\": 1748830061331142, \\"22\\": 1748830061371125, \\"23\\": 1748830061461689}"}', event WatchedEvent(type='CHANGED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-juju-os-542-1-0') 06/02/2025 02:07:42.433 7fe934674198 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:07:42.434 7fe934674198 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:07:42.434 7fe934674198 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:42.434 7fe934674198 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 06/02/2025 02:07:42.434 7fe934674198 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:42.434 7fe934674198 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:07:42.435 7fe934674198 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:07:42.435 7fe934674198 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:42.435 7fe934674198 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[] connection down >>, ] >> 06/02/2025 02:07:42.435 7fe934674198 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:42.435 7fe934674198 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:42.435 7fe934674198 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:07:42.435 7fe934674198 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:42.539 7fe9347008d0 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-juju-os-542-1-0, data b'{"ip-address": "10.0.0.129", "instance-id": "0", "redis-ip": "10.0.0.129", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{\\"0\\": 1748830060350161, \\"1\\": 1748830060363015, \\"2\\": 1748830060393532, \\"3\\": 1748830060419550, \\"4\\": 1748830060438758, \\"5\\": 1748830060476120, \\"6\\": 1748830060507115, \\"7\\": 1748830060549367, \\"8\\": 1748830060591511, \\"9\\": 1748830060646541, \\"10\\": 1748830060707181, \\"11\\": 1748830060741449, \\"12\\": 1748830060794167, \\"13\\": 1748830060842604, \\"14\\": 1748830060908822, \\"15\\": 1748830060959020, \\"16\\": 1748830060999907, \\"17\\": 1748830061057368, \\"18\\": 1748830061104403, \\"20\\": 1748830061162452, \\"21\\": 1748830061331142, \\"22\\": 1748830061371125, \\"23\\": 1748830061461689, \\"24\\": 1748830061551771, \\"25\\": 1748830061565042, \\"26\\": 1748830061674566, \\"27\\": 1748830061719504, \\"28\\": 1748830061766512, \\"29\\": 1748830061820678, \\"19\\": 1748830061893862}"}', event WatchedEvent(type='CHANGED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-juju-os-542-1-0') 06/02/2025 02:07:42.899 7fe937a69ac8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:42.900 7fe937a69ac8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:07:42.900 7fe937a69ac8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:45.599 7fe933dc8240 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:45.600 7fe933dc8240 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:07:45.600 7fe933dc8240 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:45.867 7fe937a69ac8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQdxs4IVxslGW7f9XjR17mNhVhtIdZbDzOFrUlyv0rZggef1GzmnbbVNxY6S8ERilhSFV9Cjz5gbgopIX8vTy_V9pWFVngbf5Ql6s7jZhu1630bPlR8b-Is2R4cR9yVNOcF8K2aRqDHrhTLsKXmM-zpiQ9btJOjLMeykSUq1XPguVcA 06/02/2025 02:07:45.867 7fe937a69ac8 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:07:45.868 7fe937a69ac8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 796 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:07:46.415 7fe937a69ac8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQdyDLroGo-pHNpuOJ6pJMgJstisHyX1Ck86nTa0ueUQc86AbBDkRpGVX9aIqb2s6motFXeWtMeDohTrE9YGz-_0zKBWJ4qU43kER0iEMouCeGGYmJtmMcwcUaU6301AtZbD5TfdzRo7Rjs8TZDvAYRhYq7osszRMJl-bKdX0LwOwXM 06/02/2025 02:07:46.415 7fe937a69ac8 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:07:46.416 7fe937a69ac8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 664 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:07:46.436 7fe933dc8ac8 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:07:51.444 7fe933dc8ac8 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:07:51.444 7fe933dc8ac8 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:07:51.444 7fe933dc8ac8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:51.445 7fe933dc8ac8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:07:51.445 7fe933dc8ac8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:07:51.445 7fe933dc8ac8 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:07:51.445 7fe933dc8ac8 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:07:51.445 7fe933dc8ac8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:51.445 7fe933dc8ac8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:07:51.446 7fe933dc8ac8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:51.446 7fe933dc8ac8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:51.446 7fe933dc8ac8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:07:51.446 7fe933dc8ac8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:07:55.447 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:08:00.455 7fe935cb00f0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:08:00.455 7fe935cb00f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:08:00.455 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:00.456 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:08:00.456 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:00.456 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:08:00.456 7fe935cb00f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:08:00.456 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:00.457 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:08:00.457 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:00.457 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:00.457 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:08:00.457 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:04.459 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:08:09.462 7fe935cb00f0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:08:09.463 7fe935cb00f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:08:09.463 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:09.463 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:08:09.463 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:09.463 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:08:09.464 7fe935cb00f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:08:09.464 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:09.464 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:08:09.464 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:09.464 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:09.465 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:08:09.465 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:10.381 7fe935cb00f0 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 06/02/2025 02:08:11.819 7fe935cb00f0 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 06/02/2025 02:08:13.464 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:08:15.445 7fe93d60a780 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:08:18.468 7fe935cb00f0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:08:18.468 7fe935cb00f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:08:18.469 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:18.469 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:08:18.469 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:18.469 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:08:18.469 7fe935cb00f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:08:18.470 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:18.470 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:08:18.470 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:18.470 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:18.470 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:08:18.470 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:22.468 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:08:27.473 7fe935cb00f0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:08:27.473 7fe935cb00f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:08:27.473 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:27.473 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:08:27.473 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:27.474 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:08:27.474 7fe935cb00f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:08:27.474 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:27.474 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:08:27.475 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:27.475 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:27.475 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:08:27.475 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:30.695 7fe935cb00f0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:08:31.474 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:08:36.477 7fe935cb00f0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:08:36.483 7fe935cb00f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:08:36.484 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:36.484 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:08:36.484 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:36.484 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:08:36.485 7fe935cb00f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:08:36.485 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:36.485 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:08:36.485 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:36.485 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:36.485 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:08:36.485 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:40.480 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:08:45.486 7fe935cb00f0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:08:45.487 7fe935cb00f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:08:45.487 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:45.487 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:08:45.487 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:45.487 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:08:45.488 7fe935cb00f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:08:45.488 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:45.488 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:08:45.488 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:45.488 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:45.488 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:08:45.488 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:46.922 7fe935cb00f0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQeuvY8Gp0-i2ecQ9_G39eih3O8W9ZZVmpoNGms-VnOxOA-A05YWpQrXVDCP_dcMY0xXoiHez_hKjQ_f8kzpgwj-IrdCKvkICTtk7yPvWR4s2Zy_EZ5DCsfvClxqmPEB8pbWPf6T4xc9vkveKzeBOa54PR6oVJM6FR2MbP1SbsJQ1qE 06/02/2025 02:08:46.922 7fe935cb00f0 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:08:46.923 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 483 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:08:47.405 7fe935cb00f0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQev7bdTRDbIn6vS7uBWaPC41OjX1HJgj4vze3_B75mh9NDXReBgdWEwua3VWb-1L9V1hZ6gGZ69Cv-08dCmpIKzaAn6SW-f95MLrqFJ0cKiF2_WNa43fHLxxudw3eAIAGFWOEsSSZUqXGH8cXKyrl1H-_f0CGhDug7acFHl5YSEB1E 06/02/2025 02:08:47.405 7fe935cb00f0 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:08:47.406 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 456 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:08:49.488 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:08:52.421 7fe933dca780 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:08:54.491 7fe935cb00f0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:08:54.491 7fe935cb00f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:08:54.491 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:54.492 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:08:54.492 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:08:54.492 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:08:54.492 7fe935cb00f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:08:54.493 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:54.493 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:08:54.493 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:54.493 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:54.493 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:08:54.494 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:08:58.495 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:09:02.864 7fe933dcaac8 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:09:03.497 7fe935cb00f0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:09:03.498 7fe935cb00f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:09:03.498 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:03.498 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:09:03.498 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:03.498 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:09:03.499 7fe935cb00f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:09:03.499 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:03.499 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:09:03.499 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:03.499 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:03.499 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:09:03.500 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:07.499 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:09:12.503 7fe935cb00f0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:09:12.503 7fe935cb00f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:09:12.503 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:12.503 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:09:12.503 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:12.503 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:09:12.504 7fe935cb00f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:09:12.504 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:12.504 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:09:12.504 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:12.504 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:12.504 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:09:12.504 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:16.504 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:09:21.507 7fe935cb00f0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:09:21.507 7fe935cb00f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:09:21.507 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:21.508 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:09:21.508 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:21.508 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:09:21.509 7fe935cb00f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:09:21.509 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:21.509 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:09:21.509 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:21.509 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:21.510 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:09:21.510 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:25.511 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:09:30.516 7fe935cb00f0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:09:30.517 7fe935cb00f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:09:30.517 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:30.517 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:09:30.517 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:30.517 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:09:30.517 7fe935cb00f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:09:30.518 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:30.518 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:09:30.518 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:30.518 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:30.518 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:09:30.518 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:34.520 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:09:39.526 7fe935cb00f0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:09:39.526 7fe935cb00f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:09:39.526 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:39.526 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:09:39.526 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:39.526 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:09:39.527 7fe935cb00f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:09:39.527 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:39.527 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:09:39.527 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:39.527 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:39.527 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:09:39.527 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:43.529 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:09:48.048 7fe933deba20 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQfrvCZlncJrAVi2oLQgSRbTVuTt9lnQtopnnYRDbV5XgGeLl2gkVTlr9Ffv6ocSS4cAGZcZEVI8YKQK-XZphLa_yXZw4UwqySUMLpaCHRCb-mttwO8G0xrum6zzlmP26e3YRpV66QEtdM4u46RqpwO9lXBi0azMNTWJX8R1LJlKpHI 06/02/2025 02:09:48.048 7fe933deba20 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:09:48.049 7fe933de26d8 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 506 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:09:48.049 7fe933de26d8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 506 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:09:48.494 7fe933deba20 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQfsw6Q8KRwc2JARm_E5SsVq9MvEoVR0Aa4L59qG2Ehyqcrf7uDpFPXJ4fNnXL_i_x5zfkXgnMMyi-eAo1PwYqhZC2xs0BCVKXOu7TwSORepNpWirQHpYl6LqP5IErrFy8CFITk4upGKgIBGq1DgWXDoZjhR67LHMdZhX_8esRKHm3Q 06/02/2025 02:09:48.494 7fe933deba20 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:09:48.495 7fe933dd7588 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 1023 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:09:48.495 7fe933dd7588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 1023 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:09:48.531 7fe935cb00f0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:09:48.531 7fe935cb00f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:09:48.531 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:48.531 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:09:48.532 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:48.532 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:09:48.532 7fe935cb00f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:09:48.532 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:48.532 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:09:48.532 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:48.532 7fe935cb00f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:48.533 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:09:48.533 7fe935cb00f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:52.532 7fe933deba20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:09:57.535 7fe933deba20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:09:57.535 7fe933deba20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:09:57.535 7fe933deba20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:57.535 7fe933deba20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:09:57.536 7fe933deba20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:09:57.536 7fe933deba20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:09:57.536 7fe933deba20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:09:57.536 7fe933deba20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:57.536 7fe933deba20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:09:57.536 7fe933deba20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:57.536 7fe933deba20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:09:57.536 7fe933deba20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:09:57.537 7fe933deba20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:01.537 7fe933de2978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:10:06.539 7fe933de2978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:10:06.540 7fe933de2978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:10:06.540 7fe933de2978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:06.540 7fe933de2978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:10:06.540 7fe933de2978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:06.540 7fe933de2978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:10:06.541 7fe933de2978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:10:06.541 7fe933de2978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:06.541 7fe933de2978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:10:06.541 7fe933de2978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:06.541 7fe933de2978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:06.541 7fe933de2978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:10:06.541 7fe933de2978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:10.543 7fe933de2978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:10:15.550 7fe933de2978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:10:15.570 7fe933de2978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:10:15.571 7fe933de2978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:15.571 7fe933de2978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:10:15.571 7fe933de2978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:15.571 7fe933de2978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:10:15.572 7fe933de2978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:10:15.572 7fe933de2978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:15.572 7fe933de2978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:10:15.572 7fe933de2978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:15.572 7fe933de2978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:15.572 7fe933de2978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:10:15.572 7fe933de2978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:19.552 7fe933de2978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:10:23.858 7fe937a69ac8 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:10:24.555 7fe933de2978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:10:24.555 7fe933de2978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:10:24.556 7fe933de2978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:24.556 7fe933de2978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:10:24.556 7fe933de2978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:24.556 7fe933de2978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:10:24.556 7fe933de2978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:10:24.556 7fe933de2978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:24.557 7fe933de2978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:10:24.557 7fe933de2978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:24.557 7fe933de2978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:24.557 7fe933de2978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:10:24.557 7fe933de2978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:28.557 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:10:33.561 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:10:33.561 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:10:33.561 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:33.561 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:10:33.561 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:33.561 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:10:33.562 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:10:33.562 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:33.562 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:10:33.562 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:33.562 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:33.562 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:10:33.562 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:34.513 7fe933dd7cc0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:10:37.562 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:10:42.564 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:10:42.565 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:10:42.565 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:42.565 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:10:42.565 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:42.565 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:10:42.566 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:10:42.566 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:42.566 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:10:42.566 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:42.566 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:42.566 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:10:42.566 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:46.565 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:10:49.033 7fe933de2630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQgo8tSTfLMfH9anWv4C9KdoWua2sRSeb5-FxVjmEZDlvqJInJa8Yi7kdqsOcptwAilpY9jaG9auYjiJDR_VQp7oBm0jVlrysKEeipAjD29smDrGMUmu9jd5S3CdOlCEX_qFew2y_qrumKoqvM1JtatM5f2QnVn3V52RVPUqZhZS6iU 06/02/2025 02:10:49.033 7fe933de2630 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:10:49.034 7fe933de2f60 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 650 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:10:49.034 7fe933de2f60 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 650 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:10:49.497 7fe933de2630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQgp9rO28pMYc5wOb4WfpIXhXopeYx9BQ_the2b8wA8fBvWUtfa8gr391GhqJi65NG4OtVpM4KMVsYFwb74u6SzT-RwvA5nF9z45a260DF36qIve22iMzJF7LW64Zn1TtVnjkbvUw6HA52iomvYzUAGYr_pCAh5oQmhymSs1Eu0j9WE 06/02/2025 02:10:49.497 7fe933de2630 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:10:49.498 7fe933dca438 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 470 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:10:49.498 7fe933dca438 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 470 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:10:51.568 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:10:51.568 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:10:51.568 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:51.568 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:10:51.568 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:10:51.568 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:10:51.569 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:10:51.569 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:51.569 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:10:51.569 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:51.569 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:51.569 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:10:51.569 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:10:55.571 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:11:00.573 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:11:00.574 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:11:00.574 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:00.574 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:11:00.574 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:00.574 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:11:00.575 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:11:00.575 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:00.575 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:11:00.576 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:00.576 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:00.576 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:11:00.576 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:04.575 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:11:05.790 7fe933e6a2e8 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:11:09.582 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:11:09.582 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:11:09.582 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:09.582 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:11:09.582 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:09.582 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:11:09.583 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:11:09.583 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:09.583 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:11:09.583 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:09.583 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:09.583 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:11:09.583 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:13.583 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:11:18.588 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:11:18.589 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:11:18.589 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:18.589 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:11:18.589 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:18.589 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:11:18.590 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:11:18.590 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:18.590 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:11:18.590 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:18.590 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:18.590 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:11:18.590 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:22.591 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:11:27.594 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:11:27.594 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:11:27.595 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:27.595 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:11:27.595 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:27.595 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:11:27.595 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:11:27.595 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:27.596 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:11:27.596 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:27.596 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:27.596 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:11:27.596 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:31.596 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:11:36.599 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:11:36.599 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:11:36.599 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:36.600 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:11:36.600 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:36.600 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:11:36.601 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:11:36.601 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:36.601 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:11:36.601 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:36.602 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:36.602 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:11:36.602 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:40.602 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:11:45.605 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:11:45.605 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:11:45.605 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:45.605 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:11:45.605 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:45.605 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:11:45.606 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:11:45.606 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:45.606 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:11:45.606 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:45.606 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:45.607 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:11:45.607 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:49.608 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:11:50.022 7fe933debeb8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQhlFrWVdHLPIuT_rxNh7D2Cum5njwyzQAAhpUy6sGm5WJeTLV-BepqmDAURIb8QHlYJvx-ZoTQGAwj3EcqZTbwOAjdUVRrzZ1VxE-BEm6FN0__bnyMpVZvmkQR2FbMl6AeRyC9DLDsNakOXc30QSsBu2c1no7KsZBfk1h7eBDX86gk 06/02/2025 02:11:50.022 7fe933debeb8 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:11:50.022 7fe933e62978 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 565 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:11:50.023 7fe933e62978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 565 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:11:50.479 7fe933e62978 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQhmVpj31IWA66AxKm9cLjR7YdckOBx1i1UtubBiCzkT4Zju7ImZTD-p6G6iaMro9H5Fl3lLpiG6NLxKaVPwY9yt5skrcNnjPbqYhYUWVleDM3o-KDZgiEFgP5Yl3xLWmg5h8gxdy9YqcND99Xoxax0n2ATxSmBdy6vWqR32JMSmv3Q 06/02/2025 02:11:50.479 7fe933e62978 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:11:50.479 7fe933e62d68 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 503 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:11:50.479 7fe933e62d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 503 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:11:54.611 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:11:54.611 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:11:54.611 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:54.611 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:11:54.611 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:11:54.611 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:11:54.612 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:11:54.612 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:54.612 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:11:54.612 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:54.612 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:54.612 7fe933dd7cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:11:54.612 7fe933dd7cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:11:56.147 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:11:58.613 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:12:03.617 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:12:03.618 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:12:03.618 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:03.618 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:12:03.618 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:03.618 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:12:03.619 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:12:03.619 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:03.619 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:12:03.620 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:03.620 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:03.620 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:12:03.620 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:07.619 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:12:12.623 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:12:12.623 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:12:12.623 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:12.623 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:12:12.623 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:12.623 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:12:12.624 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:12:12.624 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:12.624 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:12:12.624 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:12.624 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:12.625 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:12:12.625 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:16.624 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:12:21.626 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:12:21.626 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:12:21.626 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:21.627 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:12:21.627 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:21.627 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:12:21.627 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:12:21.627 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:21.627 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:12:21.627 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:21.627 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:21.628 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:12:21.628 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:25.631 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:12:30.637 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:12:30.637 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:12:30.637 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:30.637 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:12:30.637 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:30.637 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:12:30.638 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:12:30.638 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:30.638 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:12:30.638 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:30.638 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:30.638 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:12:30.638 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:34.640 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:12:39.646 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:12:39.646 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:12:39.646 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:39.647 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:12:39.647 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:39.647 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:12:39.647 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:12:39.647 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:39.647 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:12:39.647 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:39.648 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:39.648 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:12:39.648 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:43.650 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:12:48.654 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:12:48.654 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:12:48.655 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:48.655 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:12:48.655 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:48.655 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:12:48.655 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:12:48.656 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:48.656 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:12:48.656 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:48.656 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:48.656 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:12:48.656 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:50.993 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQii9B3K8uMpbCQ8ixmosM5g_etDGiAcYKV9iS02vGi-MCemdW4AvIUqa5knD_HqXGTy_iKavome8z0By6heAtzbTVvmXm39aGd2LPjSaTDpvXKoziQKfq0MsQhnQ5Qv3ODnCNa57bxlwSlFi4_ZFl0EUjWGlZDctuUYUkFBmeg8l-o 06/02/2025 02:12:50.993 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:12:50.993 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 468 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:12:51.436 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQij3ca0rTPIsmbH60ds2mAKdPD9vtd_s0IuFM_vWlZWNWPL5Vcms8KT5kJjp3PkzxWi8SGuSvFYkGLYEu_T0_JCsOjSjNGoaBxVk4QPhS0-34Un8BN1S8BtJNBtwtdTN3DGlCZUmss4FSocptkyb82blgR-Fk8MfkDTtAwNFC7jiYA 06/02/2025 02:12:51.436 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:12:51.436 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 446 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:12:52.655 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:12:57.657 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:12:57.658 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:12:57.658 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:57.658 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:12:57.658 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:12:57.658 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:12:57.659 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:12:57.659 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:57.659 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:12:57.659 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:57.659 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:12:57.659 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:12:57.659 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:01.658 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:13:06.661 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:13:06.661 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:13:06.661 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:06.662 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:13:06.662 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:06.662 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:13:06.662 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:13:06.662 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:06.662 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:13:06.662 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:06.662 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:06.663 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:13:06.663 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:09.369 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 06/02/2025 02:13:10.662 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:13:10.814 7fe933dd0828 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 06/02/2025 02:13:15.664 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:13:15.664 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:13:15.664 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:15.664 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:13:15.664 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:15.665 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:13:15.665 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:13:15.665 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:15.665 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:13:15.665 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:15.665 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:15.665 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:13:15.665 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:19.668 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:13:24.670 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:13:24.671 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:13:24.671 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:24.671 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:13:24.671 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:24.671 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:13:24.671 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:13:24.671 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:24.672 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:13:24.672 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:24.672 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:24.672 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:13:24.672 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:28.673 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:13:33.677 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:13:33.678 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:13:33.678 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:33.678 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:13:33.678 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:33.678 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:13:33.678 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:13:33.678 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:33.678 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:13:33.678 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:33.679 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:33.679 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:13:33.679 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:37.678 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:13:42.682 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:13:42.682 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:13:42.682 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:42.682 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:13:42.682 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:42.683 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:13:42.683 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:13:42.683 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:42.683 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:13:42.683 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:42.683 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:42.683 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:13:42.684 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:46.683 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:13:51.687 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:13:51.687 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:13:51.687 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:51.687 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:13:51.687 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:13:51.687 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:13:51.688 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:13:51.688 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:51.688 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:13:51.688 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:51.688 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:51.688 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:13:51.688 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:13:51.942 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQjfPTcfS_7jJ9BbfSbJe59Xquy2BfQFxrjXGP5UUuavA2t_Lq79o8NYduofyNuY8heoR-elY2jKhekiTOQiZ9Ty8bueEEnNqg7o5oggJ0-wcVmdiMjqSVgwYlQX-oT5pC69PUs_nThv-ndLMHN35G1Zt7aABgd1izsIiOxGWpHLnpE 06/02/2025 02:13:51.943 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:13:51.943 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 683 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:13:52.391 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQjgohqlYLq7tAHnwc9JKKCm4RQi3DYknZpAM_QL4i2IEexBiAsgU8dkaT4JKP0qdjgU-LG2yDiR_dQhVQwbfw26lrx-SoKippp17goJLxA5xfBT085OF4EDqR3qDEyOxIWHXxdk2ni80rhoKGxEf9tnBQcplRB9rOX2XFGx_-YZDf0 06/02/2025 02:13:52.391 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:13:52.392 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 484 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:13:55.688 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:14:00.694 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:14:00.694 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:14:00.694 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:00.694 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:14:00.694 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:00.694 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:14:00.695 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:14:00.695 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:00.695 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:14:00.695 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:00.695 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:00.695 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:14:00.695 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:04.695 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:14:09.697 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:14:09.697 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:14:09.697 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:09.697 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:14:09.697 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:09.697 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:14:09.698 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:14:09.698 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:09.698 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:14:09.698 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:09.698 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:09.698 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:14:09.698 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:13.700 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:14:18.704 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:14:18.704 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:14:18.704 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:18.705 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:14:18.705 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:18.705 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:14:18.705 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:14:18.706 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:18.706 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:14:18.706 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:18.706 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:18.706 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:14:18.706 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:22.705 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:14:27.709 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:14:27.709 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:14:27.709 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:27.709 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:14:27.709 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:27.709 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:14:27.710 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:14:27.710 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:27.710 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:14:27.710 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:27.710 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:27.710 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:14:27.710 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:31.709 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:14:36.712 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:14:36.712 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:14:36.712 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:36.713 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:14:36.713 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:36.713 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:14:36.714 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:14:36.714 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:36.714 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:14:36.714 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:36.714 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:36.714 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:14:36.714 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:40.716 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:14:45.718 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:14:45.718 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:14:45.718 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:45.719 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:14:45.719 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:45.719 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:14:45.719 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:14:45.719 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:45.719 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:14:45.719 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:45.719 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:45.719 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:14:45.719 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:49.720 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:14:52.891 7fe933dd0240 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQkc7ygCIKW2zQHoLYwRAsjC7zSLK0dO8MtApCH2N8A-tmD9vUpG5d934_uu2LEQy8l1mDKgZ06G6EaRkE7ZQC3lA404kWghCqMxHaUPhX4ssk09YMZKfUntoZZVWetB3p0as8VsNwCMYR2WNrwxpWb1GMD6_XAX9VMOpoAXnMvEa-E 06/02/2025 02:14:52.891 7fe933dd0240 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:14:52.892 7fe936b400f0 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 606 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:14:52.892 7fe936b400f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 606 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:14:53.337 7fe936b400f0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQkdxR6G_MVa99dOoJCv6KQuMA8VmwkueqfNRfhcTWXYVmt_HjvnUKp2Bbxt8hBoG2k-q_BE8bvVKjdsrPDu2S5lV7Go42j1xxJ-2y1BTKOSlHKCyW8pySYNIQvP-fbtDpteFkAZHayhmz8ib_-SquQn69ZiDgpfiAQTAHQUW1d0yKQ 06/02/2025 02:14:53.337 7fe936b400f0 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:14:53.338 7fe934691240 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 530 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:14:53.338 7fe934691240 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 530 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:14:54.724 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:14:54.724 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:14:54.724 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:54.724 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:14:54.724 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:14:54.724 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:14:54.725 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:14:54.725 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:54.725 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:14:54.725 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:54.725 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:54.725 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:14:54.725 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:14:58.726 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:15:03.729 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:15:03.729 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:15:03.730 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:03.730 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:15:03.730 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:03.730 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:15:03.731 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:15:03.731 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:03.731 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:15:03.731 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:03.731 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:03.731 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:15:03.731 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:07.731 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:15:10.181 7fe933dcad68 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:15:12.733 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:15:12.734 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:15:12.734 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:12.734 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:15:12.734 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:12.734 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:15:12.735 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:15:12.735 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:12.735 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:15:12.735 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:12.735 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:12.735 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:15:12.735 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:16.735 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:15:20.498 7fe933dca780 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:15:21.737 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:15:21.737 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:15:21.737 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:21.737 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:15:21.738 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:21.738 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:15:21.738 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:15:21.738 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:21.738 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:15:21.738 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:21.738 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:21.739 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:15:21.739 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:25.737 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:15:30.744 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:15:30.746 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:15:30.746 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:30.747 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:15:30.747 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:30.747 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:15:30.747 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:15:30.747 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:30.747 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:15:30.748 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:30.749 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:30.749 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:15:30.749 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:31.258 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:15:34.746 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:15:39.753 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:15:39.753 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:15:39.753 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:39.753 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:15:39.754 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:39.754 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:15:39.754 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:15:39.754 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:39.754 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:15:39.754 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:39.754 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:39.754 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:15:39.754 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:43.756 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:15:48.759 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:15:48.759 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:15:48.759 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:48.760 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:15:48.760 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:48.760 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:15:48.761 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:15:48.761 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:48.761 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:15:48.761 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:48.761 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:48.761 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:15:48.761 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:52.761 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:15:53.859 7fe933e62e10 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQlZQhSND_B-gS1mN2gZ5OyFIfi1gTLdY4pwFqRel-mLXofKOCZrhSI8gdfgcMid91GHYolYmgjxH60AyOY7WIacBPfAR1h5LoTmBaWgeTbfDrxKJrAHtoUvJudpqa2d7oYPv0_MUqNf1XozU6RJ6HvG9D40VbchDOQ7tHxO3awSnu4 06/02/2025 02:15:53.859 7fe933e62e10 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:15:53.859 7fe933deb828 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 495 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:15:53.860 7fe933deb828 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 495 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:15:54.295 7fe933e62e10 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQlagTYosWkUvhGaijT37-wVu5Q_tAw7LEa9GnGt4s4pv_2bAnBza1Vio8AeEQ89Sr6J32Au-O3NVTMGatC69PU_-LHWGyvu13JS2jQD0xju-zPoOyMn6qd1LZevuqUpe73Gg65DLU6N27oCfR7DViU5KYH5HzxnJ63AkIDoPfaRCUA 06/02/2025 02:15:54.295 7fe933e62e10 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:15:54.296 7fe933dcef60 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 605 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:15:54.296 7fe933dcef60 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 605 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:15:57.765 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:15:57.765 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:15:57.765 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:57.766 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:15:57.766 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:15:57.766 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:15:57.766 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:15:57.766 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:57.766 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:15:57.766 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:57.766 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:15:57.767 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:15:57.767 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:01.766 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:16:06.768 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:16:06.769 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:16:06.769 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:06.769 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:16:06.769 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:06.769 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:16:06.769 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:16:06.770 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:06.770 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:16:06.770 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:06.770 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:06.770 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:16:06.770 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:10.771 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:16:15.773 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:16:15.773 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:16:15.773 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:15.774 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:16:15.774 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:15.774 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:16:15.774 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:16:15.774 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:15.774 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:16:15.775 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:15.775 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:15.775 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:16:15.775 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:19.777 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:16:24.782 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:16:24.783 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:16:24.783 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:24.783 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:16:24.783 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:24.783 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:16:24.783 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:16:24.784 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:24.784 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:16:24.784 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:24.784 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:24.784 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:16:24.784 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:28.784 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:16:33.797 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:16:33.797 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:16:33.797 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:33.797 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:16:33.797 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:33.797 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:16:33.797 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:16:33.798 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:33.798 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:16:33.798 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:33.798 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:33.798 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:16:33.798 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:37.798 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:16:42.802 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:16:42.802 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:16:42.802 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:42.803 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:16:42.803 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:42.803 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:16:42.803 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:16:42.804 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:42.804 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:16:42.804 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:42.804 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:42.804 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:16:42.804 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:46.803 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:16:51.806 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:16:51.806 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:16:51.806 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:51.806 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:16:51.806 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:16:51.806 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:16:51.807 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:16:51.807 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:51.807 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:16:51.807 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:51.807 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:51.807 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:16:51.807 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:16:54.893 7fe937d9a390 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:16:54.908 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQmWkfLHPlJeOsMJRMkSI3ENaG_2yt71AmUew48LNXZ_WnLP0xtDs3fnSPZC1U2zKQ6pDJOCgM3YbuYhiHp92S0sG8DCkUmnEAytTz1rucarKkJWreNjT3wVqNb__NBBBfJiXsalzvtsGWxR8w9h-QTWQIXlVY144EbS1luhoI11b8A 06/02/2025 02:16:54.908 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:16:54.909 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 554 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:16:55.396 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQmXPQ4SoFDioywgH436hCnCrWOlL8wfbmZ2vOOSzf07Tqqxy85kC_QiyK96qC-0q2z6Utrta9EHr94QYWkfEreS-kUvnCK1LY9Fgn2t8iq6Sw-Y5Ka-vKTeEARLqRqXVDAJlbpRqwk3o2vA7efWa5mnfo2CxSFaSguoIkGVofyJfxY 06/02/2025 02:16:55.396 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:16:55.396 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 437 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:16:55.806 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:17:00.811 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:17:00.812 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:17:00.812 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:00.813 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:17:00.813 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:00.813 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:17:00.813 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:17:00.814 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:00.814 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:17:00.814 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:00.814 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:00.814 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:17:00.814 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:04.816 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:17:09.820 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:17:09.821 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:17:09.821 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:09.821 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:17:09.821 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:09.821 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:17:09.822 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:17:09.822 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:09.822 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:17:09.822 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:09.822 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:09.822 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:17:09.822 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:13.823 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:17:15.419 7fe933dd78d0 [contrail-analytics-api] [DEBUG]: resource list for database-node is None 06/02/2025 02:17:15.420 7fe92e8c8048 [contrail-analytics-api] [INFO]: db usage:{} 06/02/2025 02:17:15.425 7fe933e6ae10 [contrail-analytics-api] [DEBUG]: resource list for database-node is None 06/02/2025 02:17:15.426 7fe92e8c8048 [contrail-analytics-api] [INFO]: pending compaction tasks :{} 06/02/2025 02:17:18.828 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:17:18.829 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:17:18.829 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:18.829 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:17:18.829 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:18.829 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:17:18.830 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:17:18.830 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:18.830 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:17:18.830 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:18.830 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:18.830 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:17:18.830 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:22.830 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:17:27.833 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:17:27.834 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:17:27.834 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:27.834 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:17:27.834 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:27.834 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:17:27.834 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:17:27.835 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:27.835 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:17:27.835 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:27.835 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:27.835 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:17:27.835 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:31.835 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:17:36.838 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:17:36.838 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:17:36.838 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:36.838 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:17:36.838 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:36.839 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:17:36.839 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:17:36.839 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:36.839 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:17:36.839 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:36.839 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:36.840 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:17:36.840 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:40.839 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:17:45.841 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:17:45.841 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:17:45.842 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:45.842 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:17:45.842 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:45.842 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:17:45.842 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:17:45.843 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:45.843 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:17:45.843 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:45.843 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:45.843 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:17:45.843 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:49.844 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:17:54.848 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:17:54.849 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:17:54.849 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:54.850 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:17:54.850 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:17:54.850 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:17:54.850 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:17:54.850 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:54.851 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:17:54.851 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:54.851 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:54.851 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:17:54.851 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:17:55.917 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQnT1ujEDlZ5zsJZD1WbJh099qcmiDVMo6ND-skmo2SJpHoJINSmOtikXxxrRm8aCkjf8kQ1wUecaPrt9hzE9rlKrf3U60WLVXW5l_YAkqt9d4pX9GWWQ377BPOZpe_jkUOp6B0NLpYljCJBt_dag3dbaufmxSmPecm_Jm15F9DcBqU 06/02/2025 02:17:55.917 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:17:55.917 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 465 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:17:56.346 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQnUF7781QQUvAZ1pwhyg_dnJNcgm2MHeXzX0jR7vhfeeN76ckXJmiQBuOz7wxHEdXeyt-me572-dNiVdPO4SNn0POqY5ulEQpNgQ1AVr_HAx9oPjfSd8iqXgTKRRrI70G1yIG_mfvV1fD7z3R9Lf-DaSvCIjStLgs9LZiYycnsoj4Q 06/02/2025 02:17:56.346 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:17:56.347 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 1222 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:17:58.851 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:18:03.856 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:18:03.857 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:18:03.857 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:03.857 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:18:03.857 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:03.857 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:18:03.858 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:18:03.858 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:03.858 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:18:03.858 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:03.858 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:03.858 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:18:03.858 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:07.857 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:18:09.413 7fe933dca0f0 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 06/02/2025 02:18:10.855 7fe933dca0f0 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 06/02/2025 02:18:12.860 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:18:12.861 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:18:12.861 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:12.861 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:18:12.861 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:12.861 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:18:12.862 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:18:12.862 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:12.862 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:18:12.862 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:12.862 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:12.862 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:18:12.862 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:16.862 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:18:21.865 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:18:21.865 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:18:21.865 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:21.865 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:18:21.865 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:21.865 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:18:21.866 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:18:21.866 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:21.866 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:18:21.866 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:21.866 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:21.866 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:18:21.867 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:25.865 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:18:30.866 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:18:30.867 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:18:30.867 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:30.867 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:18:30.867 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:30.867 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:18:30.867 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:18:30.867 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:30.868 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:18:30.868 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:30.868 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:30.868 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:18:30.868 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:34.871 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:18:39.873 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:18:39.873 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:18:39.873 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:39.873 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:18:39.873 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:39.874 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:18:39.874 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:18:39.874 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:39.874 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:18:39.874 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:39.874 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:39.874 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:18:39.875 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:43.877 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:18:48.881 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:18:48.882 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:18:48.882 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:48.882 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:18:48.882 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:48.882 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:18:48.883 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:18:48.883 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:48.883 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:18:48.883 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:48.883 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:48.883 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:18:48.883 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:52.882 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:18:56.838 7fe933de2cc0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQoQdkeCjjcE0zFDrSF9HXqXUS9e1W2ZF9sm30arBvsRgHadMOSTpgMiHY8QhNL_JuHRszjU3z7YHEqI-1dtwcfLpuuMXoW1Un8e9HccbxQw7HCzMry_8pV0sGywtoUvkrRy9pTM16ENHfF9cKbeKGvoPQ5TxtrqaOEzs7J_2kxJBSU 06/02/2025 02:18:56.838 7fe933de2cc0 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:18:56.838 7fe933dd7b70 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 642 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:18:56.839 7fe933dd7b70 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 642 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:18:57.284 7fe933de2cc0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQoRb6_h1MCQ-XjQgoD3J-Le6yVzPs27BsEa7xssuMxq4jFXxGwv0mSG6EPAA8a3lVPh448UByFlhNG27htXzyDRKynLyKDEu8lGp_8GYMu-b4sdndd643NHk1qy48Tb02vJwtnvGWmq_V_tsAUvwfsd0kcM4U_4bMFzr6ZnYEn3VGQ 06/02/2025 02:18:57.284 7fe933de2cc0 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:18:57.285 7fe933dd9b70 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 566 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:18:57.285 7fe933dd9b70 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 566 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:18:57.884 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:18:57.884 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:18:57.884 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:57.884 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:18:57.884 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:18:57.884 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:18:57.885 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:18:57.885 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:57.885 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:18:57.885 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:57.885 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:18:57.885 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:18:57.885 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:01.884 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:19:06.887 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:19:06.887 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:19:06.888 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:06.888 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:19:06.888 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:06.888 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:19:06.888 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:19:06.888 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:06.889 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:19:06.889 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:06.889 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:06.889 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:19:06.889 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:10.888 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:19:15.890 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:19:15.890 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:19:15.890 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:15.890 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:19:15.890 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:15.890 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:19:15.891 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:19:15.891 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:15.891 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:19:15.891 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:15.891 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:15.891 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:19:15.891 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:19.891 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:19:24.896 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:19:24.896 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:19:24.897 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:24.897 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:19:24.897 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:24.897 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:19:24.898 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:19:24.898 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:24.898 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:19:24.898 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:24.898 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:24.899 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:19:24.899 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:28.899 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:19:33.902 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:19:33.902 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:19:33.902 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:33.903 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:19:33.903 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:33.903 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:19:33.903 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:19:33.903 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:33.904 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:19:33.904 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:33.904 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:33.904 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:19:33.904 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:37.904 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:19:42.907 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:19:42.907 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:19:42.907 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:42.907 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:19:42.907 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:42.907 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:19:42.908 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:19:42.908 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:42.908 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:19:42.908 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:42.908 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:42.908 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:19:42.908 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:46.909 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:19:51.912 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:19:51.912 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:19:51.912 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:51.912 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:19:51.913 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:19:51.913 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:19:51.913 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:19:51.913 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:51.913 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:19:51.913 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:51.914 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:51.914 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:19:51.914 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:19:55.912 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:19:57.800 7fe933e5c4e0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQpNXYk3iAch-xXeO6oTVCpjmI-4adEM7SUg-xxSE2EIgxfEE4sdNStuRva9N9ch2TEWPAwVYOSV-n2OlTI3b5QTDX-CETaB54ZR80auDqEX-HQh1o0xnHnmDTAM_vP7SASqRAfyW8IlcoeEOuKTnc12tkZWQz9KJ79ZmoACvvO4ym8 06/02/2025 02:19:57.800 7fe933e5c4e0 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:19:57.801 7fe933e6af60 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 469 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:19:57.801 7fe933e6af60 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 469 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:19:58.245 7fe933e5c4e0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQpOU4ArvNd1cRIFqAr8uKok5uJ1k6LlE7pgdRifNloyVzRE92P798b7uFG4GhAIWx_5Lf5FQGiiyNsb8xsC9wJqPj8T_AS0XNLOElwHqHgHx749xmaVNFbZ7si6xLn5-Q_N0yyNlrJifi6hPfi00tr6zKXZOFTttkofOzw_v4T2Vug 06/02/2025 02:19:58.245 7fe933e5c4e0 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:19:58.246 7fe933debcc0 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 587 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:19:58.246 7fe933debcc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 587 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:20:00.914 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:20:00.914 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:20:00.914 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:00.914 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:20:00.915 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:00.915 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:20:00.915 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:20:00.915 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:00.916 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:20:00.916 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:00.916 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:00.916 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:20:00.916 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:04.917 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:20:09.921 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:20:09.922 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:20:09.922 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:09.922 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:20:09.923 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:09.923 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:20:09.924 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:20:09.924 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:09.925 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:20:09.925 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:09.925 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:09.925 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:20:09.925 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:13.925 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:20:18.930 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:20:18.930 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:20:18.930 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:18.930 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:20:18.930 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:18.930 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:20:18.931 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:20:18.931 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:18.931 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:20:18.931 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:18.931 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:18.931 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:20:18.932 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:22.606 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:20:22.931 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:20:27.935 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:20:27.935 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:20:27.935 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:27.935 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:20:27.935 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:27.935 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:20:27.936 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:20:27.936 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:27.936 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:20:27.936 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:27.936 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:27.936 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:20:27.936 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:31.935 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:20:33.305 7fe93d60a780 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:20:36.938 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:20:36.938 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:20:36.938 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:36.938 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:20:36.939 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:36.939 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:20:36.939 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:20:36.939 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:36.939 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:20:36.939 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:36.939 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:36.939 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:20:36.939 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:40.938 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:20:43.730 7fe935cad390 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:20:45.941 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:20:45.941 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:20:45.941 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:45.941 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:20:45.941 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:45.941 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:20:45.942 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:20:45.942 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:45.942 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:20:45.942 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:45.942 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:45.942 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:20:45.942 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:49.945 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:20:54.952 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:20:54.952 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:20:54.952 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:54.952 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:20:54.952 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:20:54.952 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:20:54.953 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:20:54.953 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:54.953 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:20:54.953 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:54.953 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:54.953 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:20:54.953 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:20:58.754 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQqKCrPOlqokQN6n8-dcN_qSZ0LjyuKl3B0ar38olR0ZnwfRKLgjh6MYsGrkee54RjWmHVhTB4_AV588xDs3uqh_IJA37mihUSqmvhVBKM9ltiH2yvaRSKQYYymsit_eMQuMkxssool1NtHlCZSQI4Q0hifeDuFu24vP8qXiIZOYavU 06/02/2025 02:20:58.754 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:20:58.754 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 678 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:20:58.952 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:20:59.225 7fe933de2f60 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQqL_SUJkUnoMGOQ6q-0v3z6NRnXQEoBx6ARq4MI9t6YD_xvpE3zNiCV2ID4gU2n3cvdzCYyjT5HBU9_d9P0Royw7-EwIOo0UkvstzlYKNMdHHvqQhUrJ1v4X4tEIkPXME3wUsjY36Rf1ykV0V4yVu0dAXD55SvTg24p7k2447g0kwo 06/02/2025 02:20:59.225 7fe933de2f60 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:20:59.226 7fe933deb8d0 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 755 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:20:59.226 7fe933deb8d0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 755 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:21:03.953 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:21:03.954 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:21:03.954 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:03.954 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:21:03.954 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:03.954 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:21:03.954 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:21:03.954 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:03.955 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:21:03.955 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:03.955 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:03.955 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:21:03.955 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:07.956 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:21:12.960 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:21:12.960 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:21:12.960 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:12.960 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:21:12.960 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:12.960 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:21:12.961 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:21:12.961 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:12.961 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:21:12.961 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:12.961 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:12.961 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:21:12.961 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:16.961 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:21:21.964 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:21:21.965 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:21:21.965 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:21.965 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:21:21.965 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:21.965 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:21:21.965 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:21:21.966 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:21.966 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:21:21.966 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:21.966 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:21.966 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:21:21.966 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:25.965 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:21:30.970 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:21:30.970 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:21:30.970 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:30.970 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:21:30.970 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:30.970 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:21:30.971 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:21:30.971 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:30.971 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:21:30.971 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:30.971 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:30.971 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:21:30.971 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:34.973 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:21:39.977 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:21:39.978 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:21:39.978 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:39.978 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:21:39.978 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:39.978 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:21:39.978 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:21:39.979 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:39.979 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:21:39.979 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:39.979 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:39.979 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:21:39.979 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:43.980 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:21:48.985 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:21:48.985 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:21:48.986 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:48.986 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:21:48.986 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:48.986 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:21:48.986 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:21:48.987 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:48.987 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:21:48.987 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:48.987 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:48.987 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:21:48.987 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:52.299 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:21:52.986 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:21:57.990 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:21:57.991 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:21:57.991 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:57.991 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:21:57.991 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:21:57.991 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:21:57.991 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:21:57.992 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:57.992 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:21:57.992 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:57.992 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:57.992 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:21:57.992 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:21:59.724 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQrHpqLhNcjMEkRUh49d9L-SkwC6utVHxDm5wLvHQc_SbRvf_8ZOlldA76bgI6MjR6uTFm53qYFzGNobGCTQXUxf7tCc6C3MfyfczvLkeuQocPBEtJiLhjYKYwAQGTYG1iL3a-hOTaic34T0mibOXNRGY2ClfYS23z183Kfotr0_gPg 06/02/2025 02:21:59.724 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:21:59.724 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 479 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:22:00.197 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQrIMNxqHh_3uARQOilbXPTb5WoHQTti1THOUhtrW6EEWwsqusDu4X0K2U9pawr08JSvvAN2Rz1YbBBDS3HwJ6NUjhDOMoNqYfHhTGU44-mj3BFueiRb5BfVOGeqAtXlPA8nDTeGdm-R4oNvMe4vMK7T367gToQQE6PgR3tNyZF7BvM 06/02/2025 02:22:00.197 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:22:00.198 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 622 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:22:01.992 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:22:06.995 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:22:06.996 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:22:06.996 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:06.996 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:22:06.996 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:06.996 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:22:06.997 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:22:06.997 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:06.997 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:22:06.997 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:06.997 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:06.997 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:22:06.997 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:10.996 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:22:15.998 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:22:15.998 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:22:15.998 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:15.998 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:22:15.998 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:15.998 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:22:15.999 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:22:15.999 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:15.999 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:22:15.999 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:15.999 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:15.999 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:22:15.999 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:20.002 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:22:25.005 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:22:25.005 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:22:25.005 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:25.006 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:22:25.006 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:25.006 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:22:25.006 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:22:25.006 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:25.007 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:22:25.007 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:25.007 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:25.007 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:22:25.007 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:29.006 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:22:34.009 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:22:34.009 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:22:34.009 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:34.009 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:22:34.009 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:34.009 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:22:34.010 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:22:34.010 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:34.010 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:22:34.010 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:34.010 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:34.010 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:22:34.010 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:38.010 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:22:43.013 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:22:43.013 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:22:43.013 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:43.013 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:22:43.013 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:43.013 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:22:43.014 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:22:43.014 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:43.014 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:22:43.014 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:43.014 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:43.014 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:22:43.014 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:47.014 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:22:52.017 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:22:52.017 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:22:52.017 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:52.018 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:22:52.018 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:22:52.018 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:22:52.018 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:22:52.018 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:52.018 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:22:52.019 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:52.019 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:52.019 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:22:52.019 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:22:56.017 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:23:00.734 7fe933dd7ac8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQsED8nOzTbhR5QyjXsp-abSYlCA7BS2eLBCuSPZvK_GenefTtNhd5toNYhDw8frEzbK2nTceLw5qcPEL5kYH0xK7MVdEvEYRRKfQipeAqxAm_NS-qxLHlyPrT4iNM7mD_i56yj8z5QVy3_EnL2e7CW-TphpX_1IJMxt26tim3SssLs 06/02/2025 02:23:00.734 7fe933dd7ac8 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:23:00.734 7fe933dca978 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 497 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:23:00.735 7fe933dca978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 497 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:23:01.019 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:23:01.020 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:23:01.020 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:01.020 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:23:01.020 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:01.021 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:23:01.021 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:23:01.021 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:01.022 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:23:01.022 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:01.022 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:01.022 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:23:01.022 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:01.212 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQsFx0LeKFJEAfE7rr8jHBa9ulOwFSpoQ0NkNP10EFzB86JaU9-a8l0j7zQZbcdFqyA-Bf_53neGbYSgaYcV2_Rq-AXOLV8CMsusI75T8qIRAVsXjCrDCGYBBrCR2z6USqfdiSgsGYg2VZUEUjpIpS-dvqSjlAVZpA-F4DTXWttYWvA 06/02/2025 02:23:01.212 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:23:01.213 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 611 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:23:05.021 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:23:09.418 7fe933dca4e0 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 06/02/2025 02:23:10.023 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:23:10.023 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:23:10.023 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:10.024 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:23:10.024 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:10.024 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:23:10.024 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:23:10.024 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:10.025 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:23:10.025 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:10.025 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:10.025 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:23:10.025 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:10.857 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 06/02/2025 02:23:14.025 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:23:19.029 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:23:19.029 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:23:19.029 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:19.029 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:23:19.029 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:19.029 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:23:19.029 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:23:19.030 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:19.030 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:23:19.030 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:19.030 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:19.030 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:23:19.030 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:23.031 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:23:28.033 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:23:28.034 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:23:28.034 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:28.034 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:23:28.034 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:28.034 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:23:28.035 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:23:28.035 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:28.035 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:23:28.035 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:28.035 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:28.035 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:23:28.035 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:32.034 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:23:37.038 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:23:37.038 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:23:37.038 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:37.038 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:23:37.039 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:37.039 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:23:37.039 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:23:37.039 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:37.039 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:23:37.039 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:37.039 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:37.040 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:23:37.040 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:41.038 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:23:46.040 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:23:46.041 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:23:46.041 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:46.041 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:23:46.041 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:46.041 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:23:46.042 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:23:46.042 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:46.042 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:23:46.042 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:46.042 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:46.042 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:23:46.042 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:50.044 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:23:55.047 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:23:55.047 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:23:55.047 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:55.047 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:23:55.048 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:23:55.048 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:23:55.048 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:23:55.048 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:55.048 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:23:55.048 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:55.048 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:55.048 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:23:55.049 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:23:59.050 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:24:01.741 7fe933e5c0f0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQtBoKnKvnZkOs0CLNP_QC9nnntXMikXjg9_0WHLRH-UNc18-eOlrs8ZRtaB-PjjLh5DNTF9ObBFOmJ3O6NA0fpWL2uZZ6RPqd30BxylrXQu_dJyrF1yA5LsAYACM_Q3g22o4b_ZkxrPee8J4DAebOMV6flOaV4dMXeZwS4oxGKgbAI 06/02/2025 02:24:01.742 7fe933e5c0f0 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:24:01.742 7fe933de2ac8 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 660 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:24:01.743 7fe933de2ac8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 660 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:24:02.206 7fe933e5c0f0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQtCef-dBYz29yp2imP6CVYS3upvqvVrBrelCmJWCVtSRVgcyZ3lUNeIrEuTiVpECZ_7B1w2uwUXapj8ot40w5zkIwrIJ3J8yJ0Reg59ulR3Qsk4FsHC7kPhO3Da-zILJUKkRAlZSlCa8wANHrt178_H20bAIG36xmb879_eXHjF8ik 06/02/2025 02:24:02.206 7fe933e5c0f0 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:24:02.207 7fe933dd9d68 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 704 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:24:02.207 7fe933dd9d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 704 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:24:04.054 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:24:04.054 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:24:04.054 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:04.054 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:24:04.054 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:04.054 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:24:04.055 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:24:04.055 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:04.055 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:24:04.055 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:04.055 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:04.055 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:24:04.055 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:08.054 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:24:13.057 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:24:13.058 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:24:13.058 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:13.058 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:24:13.058 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:13.058 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:24:13.059 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:24:13.059 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:13.059 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:24:13.059 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:13.059 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:13.059 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:24:13.059 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:17.059 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:24:22.062 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:24:22.062 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:24:22.062 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:22.062 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:24:22.063 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:22.063 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:24:22.063 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:24:22.063 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:22.063 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:24:22.063 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:22.063 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:22.063 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:24:22.063 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:26.062 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:24:31.064 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:24:31.064 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:24:31.065 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:31.065 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:24:31.065 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:31.065 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:24:31.065 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:24:31.065 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:31.066 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:24:31.066 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:31.066 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:31.066 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:24:31.066 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:35.065 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:24:40.070 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:24:40.070 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:24:40.071 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:40.071 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:24:40.071 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:40.071 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:24:40.071 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:24:40.071 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:40.072 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:24:40.072 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:40.072 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:40.072 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:24:40.072 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:44.073 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:24:49.076 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:24:49.076 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:24:49.076 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:49.076 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:24:49.077 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:49.077 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:24:49.077 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:24:49.077 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:49.077 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:24:49.077 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:49.077 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:49.077 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:24:49.078 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:53.077 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:24:58.080 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:24:58.081 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:24:58.081 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:58.081 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:24:58.081 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:24:58.081 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:24:58.082 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:24:58.082 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:58.082 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:24:58.082 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:58.082 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:24:58.082 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:24:58.082 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:02.081 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:25:02.722 7fe933dcaeb8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQt-5UMXXKoWhHsQxIyEPbxXx2MgSzzlV0cEkgRSpYj-q3Ukw_LoNGqCK5R7Vc7Pd8clc_IGFnG9KtSmCLO9ZULH0TvY2bjDB56alsSL-lNKfmBEciia4tfextG60i2LjNU7bOdqzvTiScVzdk6QJTbGPFAKcZatakCkLfQaWfwo3FY 06/02/2025 02:25:02.723 7fe933dcaeb8 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:25:02.723 7fe933dca630 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 445 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:25:02.723 7fe933dca630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 445 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:25:03.190 7fe933dcaeb8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQt_QuGZkb_PDAi_wpJOeiYLv8jRSihpA5rNPVbsewdAWFbLGMOUNDOmpHWZR0OqYuLQCUsgJMn4tHA3mifyLT2ohmkNiUYDBiAgpXzXqHTtrmYOwgtq2iXUFl8lXgJu6YJfuHpb2cnLmKBTJYQZF5QgKeVgyJ4RE1QIL4qXlgEIGRM 06/02/2025 02:25:03.190 7fe933dcaeb8 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:25:03.191 7fe933dd7ac8 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 484 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:25:03.191 7fe933dd7ac8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 484 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:25:07.083 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:25:07.083 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:25:07.083 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:07.084 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:25:07.084 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:07.084 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:25:07.084 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:25:07.084 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:07.084 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:25:07.084 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:07.084 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:07.085 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:25:07.085 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:11.084 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:25:16.085 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:25:16.086 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:25:16.086 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:16.086 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:25:16.086 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:16.087 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:25:16.087 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:25:16.087 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:16.088 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:25:16.088 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:16.088 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:16.089 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:25:16.089 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:20.090 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:25:25.096 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:25:25.096 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:25:25.096 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:25.097 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:25:25.097 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:25.097 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:25:25.097 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:25:25.097 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:25.098 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:25:25.098 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:25.098 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:25.098 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:25:25.098 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:29.097 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:25:34.102 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:25:34.102 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:25:34.102 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:34.102 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:25:34.103 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:34.103 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:25:34.103 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:25:34.103 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:34.104 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:25:34.104 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:34.104 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:34.104 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:25:34.104 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:38.104 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:25:43.108 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:25:43.108 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:25:43.109 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:43.109 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:25:43.109 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:43.109 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:25:43.109 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:25:43.110 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:43.110 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:25:43.110 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:43.110 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:43.110 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:25:43.110 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:47.109 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:25:52.111 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:25:52.111 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:25:52.112 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:52.112 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:25:52.112 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:25:52.112 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:25:52.112 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:25:52.112 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:52.113 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:25:52.113 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:52.113 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:52.113 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:25:52.113 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:25:56.112 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:26:01.114 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:26:01.114 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:26:01.114 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:01.114 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:26:01.114 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:01.114 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:26:01.115 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:26:01.115 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:01.115 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:26:01.115 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:01.116 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:01.116 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:26:01.116 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:03.694 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQu7Aca0NDSYvQSH_IsMtsxm22DM1_lqsa8U0AJGbIkBMI8zxRdU-aWxtUULlEZ_QfFeAG2x4E7SoTBLnyRVvNSG4sJaMvdFN6bASHyQhDvPVkuShtzjHnP4rZz80_zNeQvZKnwlFnk70cbkJn8PTRAi8KJ6gdxEEy8Nf4JBSy7wgF4 06/02/2025 02:26:03.694 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:26:03.695 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 502 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:26:04.150 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQu8TdvzJ7hINgR_si2p-RLILs8xyED_MnNXbUxK_QjofrhSH5R9Dxv_RQLNqNZw0XC4X6F45ORCO2Ku0_mNot4Uf9t30nW_2O0zJ1XJn36BiXzpPePxZ58W_RRLSETbD_aoSGFLfpEVXoAvBvR9xa88oFw05IRcdwez3foBKnfI31A 06/02/2025 02:26:04.150 7fe933c9f4e0 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:26:04.150 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 446 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:26:05.115 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:26:10.122 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:26:10.122 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:26:10.122 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:10.123 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:26:10.123 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:10.123 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:26:10.123 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:26:10.123 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:10.123 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:26:10.124 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:10.124 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:10.124 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:26:10.124 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:14.124 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:26:14.555 7fe933dd74e0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:26:19.127 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:26:19.128 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:26:19.128 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:19.128 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:26:19.128 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:19.128 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:26:19.129 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:26:19.129 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:19.129 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:26:19.129 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:19.129 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:19.129 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:26:19.129 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:23.128 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:26:24.855 7fe933e62828 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:26:28.132 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:26:28.132 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:26:28.132 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:28.132 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:26:28.133 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:28.133 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:26:28.133 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:26:28.133 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:28.133 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:26:28.133 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:28.133 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:28.134 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:26:28.134 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:32.132 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:26:35.385 7fe933deb4e0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:26:37.134 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:26:37.135 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:26:37.135 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:37.135 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:26:37.135 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:37.135 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:26:37.135 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:26:37.135 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:37.136 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:26:37.136 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:37.136 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:37.136 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:26:37.136 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:41.135 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:26:46.137 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:26:46.137 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:26:46.137 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:46.138 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:26:46.138 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:46.138 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:26:46.138 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:26:46.139 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:46.139 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:26:46.139 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:46.139 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:46.139 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:26:46.139 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:50.141 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:26:55.148 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:26:55.148 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:26:55.148 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:55.148 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:26:55.148 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:26:55.148 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:26:55.150 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:26:55.150 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:55.150 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:26:55.150 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:55.150 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:55.150 7fe933c9f4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:26:55.150 7fe933c9f4e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:26:59.149 7fe934674ac8 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:27:04.153 7fe934674ac8 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:27:04.153 7fe934674ac8 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:27:04.153 7fe934674ac8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:04.153 7fe934674ac8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:27:04.153 7fe934674ac8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:04.153 7fe934674ac8 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:27:04.154 7fe934674ac8 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:27:04.154 7fe934674ac8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:04.154 7fe934674ac8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:27:04.154 7fe934674ac8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:04.155 7fe934674ac8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:04.155 7fe934674ac8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:27:04.155 7fe934674ac8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:04.738 7fe934674ac8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQv4VDbbTpqjhsCrJGQPYHjtDF7UxxfpAgsHI9t7BY_cIBtT484o7moi1Q6pFgdh127nGKqNd5YwgPC1xLl6LEI2XGUlDAzhGrxu0YD5rFg167S5CF9XmlZ5of_FBI7iX-MjqMxR_1z79x0qxSpMIxfAoqO-rtpJJoDUS1RaJSZNQ2M 06/02/2025 02:27:04.738 7fe934674ac8 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:27:04.739 7fe934674ac8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 432 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:27:05.183 7fe934674ac8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQv5EW2_kX5NFBWzt0gTx3exKeXlochsEuvasds2T5ZaJkNLnvImbEdDFs8NX0PaPZrI2pgnJjSGyB3MOf6UOAe_HJyofg-6Nk9d1uiq8TX6NQ8dFuE--ifc3CEuYR0Axk8_tgjkqRLtasyXWRykZuzP6IHVrhIjQr_Fo4uP41hdAwU 06/02/2025 02:27:05.184 7fe934674ac8 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:27:05.184 7fe934674ac8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 570 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:27:08.154 7fe934674ac8 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:27:13.157 7fe934674ac8 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:27:13.157 7fe934674ac8 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:27:13.157 7fe934674ac8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:13.157 7fe934674ac8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:27:13.157 7fe934674ac8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:13.157 7fe934674ac8 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:27:13.158 7fe934674ac8 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:27:13.158 7fe934674ac8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:13.158 7fe934674ac8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:27:13.158 7fe934674ac8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:13.158 7fe934674ac8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:13.158 7fe934674ac8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:27:13.158 7fe934674ac8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:15.433 7fe933dd7d68 [contrail-analytics-api] [DEBUG]: resource list for database-node is None 06/02/2025 02:27:15.435 7fe92e8c8048 [contrail-analytics-api] [INFO]: db usage:{} 06/02/2025 02:27:15.438 7fe933dd7d68 [contrail-analytics-api] [DEBUG]: resource list for database-node is None 06/02/2025 02:27:15.439 7fe92e8c8048 [contrail-analytics-api] [INFO]: pending compaction tasks :{} 06/02/2025 02:27:17.158 7fe933deb0f0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:27:22.161 7fe933deb0f0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:27:22.161 7fe933deb0f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:27:22.161 7fe933deb0f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:22.161 7fe933deb0f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:27:22.161 7fe933deb0f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:22.161 7fe933deb0f0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:27:22.162 7fe933deb0f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:27:22.162 7fe933deb0f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:22.162 7fe933deb0f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:27:22.162 7fe933deb0f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:22.162 7fe933deb0f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:22.162 7fe933deb0f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:27:22.162 7fe933deb0f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:26.161 7fe933deb0f0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:27:31.162 7fe933deb0f0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:27:31.163 7fe933deb0f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:27:31.163 7fe933deb0f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:31.163 7fe933deb0f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:27:31.163 7fe933deb0f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:31.163 7fe933deb0f0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:27:31.163 7fe933deb0f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:27:31.163 7fe933deb0f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:31.164 7fe933deb0f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:27:31.164 7fe933deb0f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:31.164 7fe933deb0f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:31.164 7fe933deb0f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:27:31.164 7fe933deb0f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:35.164 7fe933deb0f0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:27:39.685 7fe933dc84e0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:27:40.167 7fe933deb0f0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:27:40.167 7fe933deb0f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:27:40.168 7fe933deb0f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:40.168 7fe933deb0f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:27:40.168 7fe933deb0f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:40.168 7fe933deb0f0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:27:40.168 7fe933deb0f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:27:40.169 7fe933deb0f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:40.169 7fe933deb0f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:27:40.169 7fe933deb0f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:40.169 7fe933deb0f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:40.169 7fe933deb0f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:27:40.169 7fe933deb0f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:44.169 7fe933e6a828 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:27:49.173 7fe933e6a828 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:27:49.173 7fe933e6a828 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:27:49.173 7fe933e6a828 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:49.173 7fe933e6a828 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:27:49.173 7fe933e6a828 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:49.173 7fe933e6a828 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:27:49.174 7fe933e6a828 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:27:49.174 7fe933e6a828 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:49.174 7fe933e6a828 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:27:49.174 7fe933e6a828 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:49.174 7fe933e6a828 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:49.175 7fe933e6a828 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:27:49.175 7fe933e6a828 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:53.174 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:27:58.178 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:27:58.178 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:27:58.178 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:58.178 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:27:58.179 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:27:58.179 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:27:58.179 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:27:58.179 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:58.179 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:27:58.179 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:58.179 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:27:58.179 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:27:58.179 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:02.179 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:28:05.699 7fe934693a20 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQw1o6iylTmPCXG_45QhYvEtKZuQuOjCWnEGS7XKbQqLliLARj_4cJ0ZY1As_J2D1wQR4ublV-2LarHUpPBUefNEo3BwmpjQxUL22_PKwmVS0NKu4I9l5x069_9YNrxCJtyVHrD9PmbzNZcG_tXtRJTrJLYXGyG4YzYlx4h3mb3yUrQ 06/02/2025 02:28:05.699 7fe934693a20 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:28:05.700 7fe933dce390 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 436 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:28:05.700 7fe933dce390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 436 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:28:06.159 7fe934693a20 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQw2Ob2n9mRIC-z00zsL0Lb2pb-JPt2p6_lI6JzBBGQn86fklmG-PkNbgHAtLQs7DrKoMYTW7ajjjdWp2HEqwc71jo7IPBsYWiyNtvorgruODUMsucef4DOeS4xiD5HAMNbc0t-6X4EZIFcRc9i9p0EAggX-rbfJt_OiWXrAuNnrYtA 06/02/2025 02:28:06.159 7fe934693a20 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:28:06.160 7fe933deb438 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 633 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:28:06.160 7fe933deb438 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 633 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:28:07.182 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:28:07.182 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:28:07.182 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:07.182 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:28:07.183 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:07.183 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:28:07.183 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:28:07.183 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:07.183 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:28:07.183 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:07.184 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:07.184 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:28:07.184 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:09.415 7fe935cad390 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 06/02/2025 02:28:10.863 7fe935cad390 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 06/02/2025 02:28:11.183 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:28:16.185 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:28:16.185 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:28:16.185 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:16.185 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:28:16.186 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:16.186 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:28:16.186 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:28:16.186 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:16.186 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:28:16.186 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:16.186 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:16.186 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:28:16.187 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:20.187 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:28:25.193 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:28:25.193 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:28:25.194 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:25.194 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:28:25.194 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:25.194 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:28:25.194 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:28:25.195 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:25.195 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:28:25.195 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:25.195 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:25.195 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:28:25.195 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:29.197 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:28:34.201 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:28:34.202 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:28:34.202 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:34.202 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:28:34.202 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:34.202 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:28:34.203 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:28:34.203 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:34.203 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:28:34.203 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:34.203 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:34.203 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:28:34.203 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:38.203 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:28:43.206 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:28:43.207 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:28:43.207 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:43.207 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:28:43.207 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:43.207 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:28:43.207 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:28:43.207 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:43.208 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:28:43.208 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:43.208 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:43.208 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:28:43.208 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:47.208 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:28:52.212 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:28:52.212 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:28:52.212 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:52.213 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:28:52.213 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:28:52.213 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:28:52.213 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:28:52.214 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:52.214 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:28:52.214 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:52.214 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:52.214 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:28:52.214 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:28:56.212 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:29:01.214 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:29:01.214 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:29:01.214 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:01.214 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:29:01.215 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:01.215 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:29:01.215 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:29:01.215 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:01.215 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:29:01.215 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:01.216 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:01.216 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:29:01.216 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:05.217 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:29:06.671 7fe933e04198 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQxyeMQf8VBEa5E0rb_q9Nk5d3wzJsyUdRCkod_kZ5sm-GOEe3DFpSHu9hS8lI2X-fyNb3oNXyG1giN49D8Uw6P_bkmfm-vYnO1zb3JRp1qjvUXPNJK8h28dGj_TW4LUPA5EY6EuA-AM6xm5DOKbKgj6zdYl1hi9cf2BKHFhR2rbt3g 06/02/2025 02:29:06.671 7fe933e04198 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:29:06.672 7fe937d9a4e0 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 488 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:29:06.672 7fe937d9a4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 488 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:29:07.097 7fe937d9a4e0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQxz-dLp7-beC04sfxgcnk9e97dKx8liWByKNnzdlcQBIlfw5QnYE-mHiXfonzJS9arKbD0aL-5o00tsegyqvCTnNGyElehpgOdrCL-PqMz9safpZUaz5Rhwtep6A9jRGKu3RL23BlQiOks29No-1mru4okXJxDfn2VWhARJzeD_lNg 06/02/2025 02:29:07.098 7fe937d9a4e0 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:29:07.098 7fe933dce780 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 449 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:29:07.098 7fe933dce780 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 449 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:29:10.220 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:29:10.220 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:29:10.220 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:10.222 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:29:10.222 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:10.222 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:29:10.222 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:29:10.223 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:10.223 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:29:10.223 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:10.223 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:10.223 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:29:10.223 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:14.220 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:29:19.225 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:29:19.226 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:29:19.226 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:19.226 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:29:19.226 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:19.226 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:29:19.227 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:29:19.227 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:19.227 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:29:19.227 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:19.227 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:19.227 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:29:19.227 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:23.228 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:29:28.230 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:29:28.230 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:29:28.230 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:28.230 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:29:28.230 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:28.230 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:29:28.231 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:29:28.231 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:28.231 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:29:28.231 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:28.231 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:28.231 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:29:28.233 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:32.231 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:29:37.233 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:29:37.234 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:29:37.234 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:37.234 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:29:37.234 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:37.234 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:29:37.234 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:29:37.234 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:37.234 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:29:37.235 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:37.235 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:37.235 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:29:37.235 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:41.233 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:29:46.235 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:29:46.235 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:29:46.235 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:46.236 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:29:46.236 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:46.236 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:29:46.237 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:29:46.237 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:46.237 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:29:46.237 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:46.237 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:46.237 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:29:46.237 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:50.236 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:29:55.242 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:29:55.242 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:29:55.242 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:55.242 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:29:55.242 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:29:55.242 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:29:55.243 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:29:55.243 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:55.243 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:29:55.243 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:55.243 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:55.243 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:29:55.243 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:29:59.245 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:30:04.249 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:30:04.249 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:30:04.249 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:04.249 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:30:04.249 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:04.249 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:30:04.250 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:30:04.250 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:04.250 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:30:04.250 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:04.250 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:04.251 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:30:04.251 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:07.599 7fe935cad390 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQyvSaeJC2Shjz2WJD-Lt4yYNVxQBsz10Q0PSfI5uvJrSk5ukHWeYY0XPeF4RyHYyHCasS3bR9pZVcL157comvaKQdC3oyJW4rUGq5ifDQJNq84D40mKNQTp05DWjEmK-nh_BHLEEOjS_TjUgZu1HMLfAneHwwqDOeV_Jz88tpA6jgs 06/02/2025 02:30:07.599 7fe935cad390 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:30:07.599 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 564 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:30:08.025 7fe935cad390 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQyvast4T7ilVeQ1vX8HhEcNz0gmm23GhVNJBqLJ39Bmp31za0H8YHKP-yyEYG2yO0LUxACU8an5ozxTPsgch8o1I1kz4a_HuyaXmBFESALPW5xGdK9bFfn6CuI2DVIlaIeMyoRQvVUWzKtyFzEJHoFwKvt2tVKwlmhVWlM7oJYg4yw 06/02/2025 02:30:08.025 7fe935cad390 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:30:08.026 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 576 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:30:08.249 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:30:13.253 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:30:13.254 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:30:13.254 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:13.254 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:30:13.254 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:13.254 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:30:13.255 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:30:13.255 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:13.255 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:30:13.255 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:13.255 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:13.255 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:30:13.255 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:17.255 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:30:22.257 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:30:22.257 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:30:22.258 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:22.258 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:30:22.258 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:22.259 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:30:22.259 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:30:22.260 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:22.260 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:30:22.260 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:22.260 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:22.260 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:30:22.260 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:26.258 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:30:31.260 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:30:31.261 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:30:31.261 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:31.261 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:30:31.261 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:31.261 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:30:31.262 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:30:31.262 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:31.262 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:30:31.262 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:31.262 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:31.262 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:30:31.262 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:35.265 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:30:40.273 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:30:40.273 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:30:40.273 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:40.274 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:30:40.274 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:40.274 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:30:40.274 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:30:40.274 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:40.274 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:30:40.274 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:40.274 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:40.274 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:30:40.275 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:44.273 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:30:49.280 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:30:49.280 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:30:49.280 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:49.281 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:30:49.281 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:49.281 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:30:49.281 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:30:49.281 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:49.281 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:30:49.281 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:49.282 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:49.282 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:30:49.282 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:53.281 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:30:58.284 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:30:58.284 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:30:58.285 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:58.285 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:30:58.285 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:30:58.285 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:30:58.285 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:30:58.285 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:58.285 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:30:58.285 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:58.286 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:58.286 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:30:58.286 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:30:58.336 7fe935cad390 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:31:02.285 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:31:07.288 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:31:07.289 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:31:07.289 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:07.289 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:31:07.289 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:07.289 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:31:07.289 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:31:07.289 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:07.289 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:31:07.289 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:07.290 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:07.290 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:31:07.290 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:08.534 7fe935cad390 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQzsHzF-njNsjsoJHjGPKcl3QY38JR5ev8SNyM0ulZvJv3FcWFcLLdtZyuzb74OpCg6EQRiJcDwqiulEHh9UGrp5MK0vRg_4oe2xNhMXcy5RJW6cGSNBlIx8kMh-kgZX18QcuYKURgSPrTpzEUzRohAilZCHUvM_Xp5wAUhQGs7pWHM 06/02/2025 02:31:08.534 7fe935cad390 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:31:08.534 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 524 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:31:08.736 7fe935cad390 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:31:09.038 7fe935cad390 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQzsBt3kAlHWQxmq-4GDWn9ShLLGnrLE6xMONW2IoSysBeUrEw4F3IQE49FOFKol5e57zvsKKaFXE3UQuni6suC_rNj2FHSKzz1BUs4eKAQDCFs9E-W3j8SGnLBhjGDXy0bbo34GoTCoaw7tHQahd35SIy0_bbJ0rsCaAHf4b4R5tL4 06/02/2025 02:31:09.038 7fe935cad390 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:31:09.039 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 491 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:31:11.288 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:31:16.290 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:31:16.290 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:31:16.290 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:16.290 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:31:16.291 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:16.291 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:31:16.291 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:31:16.291 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:16.291 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:31:16.291 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:16.292 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:16.292 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:31:16.292 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:19.317 7fe935cad390 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:31:20.291 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:31:25.297 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:31:25.297 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:31:25.297 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:25.297 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:31:25.297 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:25.297 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:31:25.298 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:31:25.298 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:25.298 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:31:25.298 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:25.298 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:25.298 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:31:25.298 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:29.299 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:31:34.305 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:31:34.305 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:31:34.305 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:34.305 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:31:34.305 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:34.305 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:31:34.306 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:31:34.306 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:34.306 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:31:34.306 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:34.306 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:34.306 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:31:34.306 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:38.307 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:31:43.310 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:31:43.310 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:31:43.310 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:43.310 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:31:43.310 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:43.310 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:31:43.311 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:31:43.311 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:43.311 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:31:43.311 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:43.311 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:43.311 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:31:43.311 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:47.311 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:31:52.314 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:31:52.314 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:31:52.315 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:52.315 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:31:52.315 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:31:52.315 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:31:52.316 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:31:52.316 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:52.316 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:31:52.316 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:52.317 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:52.317 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:31:52.317 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:31:56.315 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:32:01.316 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:32:01.317 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:32:01.317 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:01.317 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:32:01.317 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:01.317 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:32:01.318 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:32:01.318 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:01.318 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:32:01.318 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:01.318 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:01.318 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:32:01.318 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:05.320 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:32:09.554 7fe933dca438 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQ0p0lVW5fsATQdoU8xaNMkJlnCCtmB2lknzI89Bl0BiZlH68moeD1HIwiKK3WHwVl1ggudrwmeBBaGAUnN4PLJfZx_1uNG4VI8Dihu6ydrLldfSqnPsHtZkOnfYj3FggdZEGdajGObVZbXfNJcbAnQ8oLCVwfK4mPma9ve_OGi3NGw 06/02/2025 02:32:09.554 7fe933dca438 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:32:09.555 7fe933dd0978 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 501 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:32:09.555 7fe933dd0978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 501 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:32:09.991 7fe933dca438 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQ0pySziM7ejnveLmcrVIvZA_ef2IpY5It-23kJh3EwiDNjXrbrtbu9khja3X496mA58RbKTJmQn2x6thFUINqHRmmGbO8OQ7H46pHeIfxf310yjDTRFGAsl1Kw8JdrIiQ9m_kwfBtlA3TcyiROOzqoIOSCYQosaqtDaNcrUJwI_Wdo 06/02/2025 02:32:09.991 7fe933dca438 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:32:09.991 7fe933dee438 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 484 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:32:09.992 7fe933dee438 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 484 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:32:10.322 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:32:10.322 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:32:10.322 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:10.322 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:32:10.323 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:10.323 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:32:10.323 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:32:10.323 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:10.323 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:32:10.324 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:10.324 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:10.324 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:32:10.324 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:14.323 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:32:19.328 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:32:19.328 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:32:19.328 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:19.328 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:32:19.328 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:19.329 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:32:19.329 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:32:19.329 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:19.329 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:32:19.329 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:19.329 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:19.329 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:32:19.329 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:23.330 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:32:28.333 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:32:28.333 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:32:28.333 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:28.333 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:32:28.333 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:28.334 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:32:28.334 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:32:28.334 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:28.335 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:32:28.335 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:28.335 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:28.335 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:32:28.335 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:32.335 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:32:36.273 7fe9374ff198 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:32:37.337 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:32:37.338 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:32:37.338 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:37.338 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:32:37.338 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:37.338 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:32:37.339 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:32:37.339 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:37.339 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:32:37.339 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:37.339 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:37.339 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:32:37.339 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:41.338 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:32:46.340 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:32:46.340 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:32:46.340 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:46.341 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:32:46.341 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:46.341 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:32:46.341 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:32:46.342 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:46.342 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:32:46.342 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:46.342 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:46.342 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:32:46.342 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:50.344 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:32:55.349 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:32:55.349 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:32:55.349 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:55.349 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:32:55.349 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:32:55.349 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:32:55.350 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:32:55.350 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:55.350 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:32:55.350 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:55.350 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:55.350 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:32:55.350 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:32:59.352 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:33:04.356 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:33:04.356 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:33:04.356 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:04.356 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:33:04.356 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:04.356 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:33:04.357 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:33:04.357 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:04.357 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:33:04.357 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:04.357 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:04.357 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:33:04.357 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:08.357 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:33:09.429 7fe933dd9e10 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 06/02/2025 02:33:10.489 7fe933dd9e10 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQ1mlUGBeQqtx9wdkFA7Go6ceyLSYLkIgb1QfAEL9xwltORCPPwVx6JIcEpehs68saSkBUfgbwW1TyRTD-fBkPdP2nqNfKFC3mwnC2yXoJ_HHb5yehIdhqdNIBCw1Wtc8nYA_lVofxiFYzMlZQJFVBoIvgW-WNl_kj5tiKVNqmWwdVA 06/02/2025 02:33:10.490 7fe933dd9e10 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:33:10.490 7fe933e6acc0 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 528 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:33:10.490 7fe933e6acc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 528 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:33:10.868 7fe933dd9e10 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 06/02/2025 02:33:10.989 7fe933dee4e0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQ1mPBysEL0K2irYY2G434Y9bSyvne8GLLkYkhFLItCckoJAcRrbmDmwJgHLwQLeB9dAWMhH2tDkq3BatGIFZt6pjNOMSv6DZ3gYyLTOMkLH5iSvm00ETWgc9jDCnYdRyMLbjAyM2K6GLj7nj9Jddre4L77buZ9x8Etp3pj8fNHGu8g 06/02/2025 02:33:10.989 7fe933dee4e0 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:33:10.990 7fe933e6ac18 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 569 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:33:10.990 7fe933e6ac18 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 569 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:33:13.361 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:33:13.362 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:33:13.362 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:13.362 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:33:13.362 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:13.362 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:33:13.362 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:33:13.363 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:13.363 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:33:13.363 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:13.363 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:13.363 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:33:13.363 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:17.364 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:33:22.367 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:33:22.368 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:33:22.368 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:22.368 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:33:22.368 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:22.368 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:33:22.369 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:33:22.369 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:22.369 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:33:22.369 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:22.369 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:22.369 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:33:22.369 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:26.368 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:33:31.371 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:33:31.371 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:33:31.371 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:31.372 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:33:31.372 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:31.372 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:33:31.372 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:33:31.372 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:31.372 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:33:31.372 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:31.372 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:31.373 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:33:31.373 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:35.374 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:33:40.381 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:33:40.381 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:33:40.381 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:40.381 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:33:40.381 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:40.381 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:33:40.382 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:33:40.382 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:40.382 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:33:40.382 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:40.382 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:40.382 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:33:40.382 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:44.384 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:33:49.389 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:33:49.389 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:33:49.389 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:49.389 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:33:49.389 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:49.389 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:33:49.390 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:33:49.390 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:49.390 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:33:49.390 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:49.390 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:49.390 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:33:49.391 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:53.391 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:33:58.396 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:33:58.396 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:33:58.396 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:58.397 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:33:58.397 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:33:58.397 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:33:58.397 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:33:58.397 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:58.398 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:33:58.398 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:58.398 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:33:58.398 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:33:58.398 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:02.397 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:34:07.399 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:34:07.400 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:34:07.400 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:07.400 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:34:07.400 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:07.400 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:34:07.400 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:34:07.400 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:07.400 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:34:07.401 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:07.401 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:07.401 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:34:07.401 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:11.400 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:34:11.569 7fe92e8cd978 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQ2jNtPdyFTXs-7FyPA_PLQ6BpOKqXWkQBzkhgeswNY1DOERexwAQq9OiIqmnlBldUoD2zuAp6KCmg_McdRn7ETqqqjUY1zy3zqOYPcrlA6hPc438b4pDyvMiAKwtmq7D6USgX9mq-jj-GIgciJw_UBlXhUfhnYXfQ2evmc9y3bebzU 06/02/2025 02:34:11.569 7fe92e8cd978 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:34:11.570 7fe933dd9c18 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 772 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:34:11.570 7fe933dd9c18 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 772 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:34:12.002 7fe92e8cd978 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQ2jAZCzXhd4xyx8xdNzhTiQjkKZhBuroTnYVJfi2iFey-TudEQpx0TSworsFbbOTrj8J8--j3rEIMY428nzbU3gHlR0AagUFT-ZMECKqiD3BSo6eBVMK4CGnlI-mwAnw45iJKdaZsFORKFWsU-znUkb32glo-6RYj_Qu5NF-HXh-RE 06/02/2025 02:34:12.002 7fe92e8cd978 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:34:12.003 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 502 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:34:12.003 7fe935cb00f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 502 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:34:16.403 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:34:16.403 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:34:16.404 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:16.404 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:34:16.404 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:16.404 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:34:16.405 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:34:16.405 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:16.405 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:34:16.405 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:16.405 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:16.405 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:34:16.405 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:20.406 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:34:25.408 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:34:25.409 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:34:25.409 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:25.409 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:34:25.409 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:25.409 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:34:25.409 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:34:25.410 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:25.410 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:34:25.410 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:25.410 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:25.410 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:34:25.410 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:29.412 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:34:34.417 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:34:34.417 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:34:34.417 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:34.417 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:34:34.418 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:34.418 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:34:34.418 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:34:34.418 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:34.418 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:34:34.418 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:34.418 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:34.419 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:34:34.419 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:38.420 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:34:43.425 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:34:43.425 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:34:43.425 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:43.425 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:34:43.425 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:43.425 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:34:43.426 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:34:43.426 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:43.426 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:34:43.426 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:43.426 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:43.427 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:34:43.427 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:47.426 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:34:52.429 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:34:52.429 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:34:52.429 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:52.429 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:34:52.429 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:34:52.429 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:34:52.430 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:34:52.430 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:52.430 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:34:52.430 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:52.430 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:52.430 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:34:52.430 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:34:56.430 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:35:01.432 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:35:01.432 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:35:01.432 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:01.433 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:35:01.433 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:01.433 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:35:01.433 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:35:01.433 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:01.433 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:35:01.433 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:01.433 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:01.433 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:35:01.434 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:05.432 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:35:10.437 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:35:10.437 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:35:10.437 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:10.437 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:35:10.437 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:10.437 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:35:10.437 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:35:10.438 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:10.438 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:35:10.438 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:10.438 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:10.438 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:35:10.438 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:12.589 7fe935cad390 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQ3gR6dFce8eIrfaRCv9vdG-O0Kpj6P9D7c7NmOSXykRkLhAnARXdhhLRdFhrKPmjq7gKTSFAQLGZZsMKZ6Ig_orh_YmW5AewloVbI-EBh19TrxD4-3bx7sDbZpzgjzjseqAZU4iELyiy3ZIkEPoYAkDsdNAYgMIhb-XJ5wZuV3lKzE 06/02/2025 02:35:12.589 7fe935cad390 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:35:12.589 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 492 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:35:13.031 7fe935cad390 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQ3gHNoges4X0lFT3LEoUa86u9-n4d9tjKMouwmzZIx0BDvyrkumnbUeM92fXKQY5BOObK78H8OR7CHq-aXJHnlYn9GNUAEVPQhtlHvZ8uGfE6s0cwyXfk5qwZrUbWhfBWtUGlbdq-Wh-YvLFhHPYiLogsAmKqaYPW-NfeMAQ1ROmkM 06/02/2025 02:35:13.031 7fe935cad390 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:35:13.032 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 538 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:35:14.437 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:35:19.441 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:35:19.441 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:35:19.441 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:19.442 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:35:19.442 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:19.442 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:35:19.442 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:35:19.442 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:19.442 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:35:19.443 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:19.443 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:19.443 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:35:19.443 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:23.443 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:35:28.447 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:35:28.447 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:35:28.447 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:28.448 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:35:28.448 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:28.448 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:35:28.448 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:35:28.448 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:28.448 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:35:28.448 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:28.448 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:28.449 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:35:28.449 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:32.449 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:35:37.452 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:35:37.452 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:35:37.452 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:37.453 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:35:37.454 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:37.454 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:35:37.455 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:35:37.455 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:37.455 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:35:37.456 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:37.456 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:37.456 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:35:37.456 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:41.453 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:35:46.455 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:35:46.455 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:35:46.455 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:46.455 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:35:46.456 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:46.457 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:35:46.457 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:35:46.457 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:46.458 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:35:46.458 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:46.458 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:46.458 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:35:46.458 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:50.457 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:35:55.461 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:35:55.461 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:35:55.461 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:55.462 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:35:55.462 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:35:55.462 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:35:55.463 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:35:55.463 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:55.463 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:35:55.463 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:55.463 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:55.463 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:35:55.463 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:35:59.463 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:36:04.469 7fe93466c588 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:36:04.469 7fe93466c588 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:36:04.469 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:04.469 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:36:04.469 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:04.469 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:36:04.470 7fe93466c588 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:36:04.470 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:04.470 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:36:04.470 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:04.470 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:04.470 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:36:04.470 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:08.471 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:36:13.475 7fe93466c588 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:36:13.476 7fe93466c588 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:36:13.476 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:13.476 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:36:13.476 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:13.476 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:36:13.476 7fe93466c588 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:36:13.476 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:13.477 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:36:13.478 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:13.478 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:13.478 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:36:13.478 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:13.581 7fe93466c588 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQ4dpv5CRdmKjO-lESq3r_22NqQ8kTk6GLYLJvqhAc3a2LdFwmY_CkzfKgIt_U6zyKE_K-t5REtKV_tLS9cFpC_j7V2FDoNd1Z3mJ1xUh58KTdpXt5Ordo8ye21NhI7slTRMdAYHReyDSyDomx2d8M1ABlsk-yEHSHTXMzn1xhJcegI 06/02/2025 02:36:13.581 7fe93466c588 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:36:13.581 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 528 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:36:14.031 7fe93466c588 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQ4dJyrDbwKZ3d7SsqN14kh_C9tHNJ1fugbrd35iOQZzNn8n8zeU_xpq4kYRjJcwpJowvQBkOkWPrFr6dXgm7O-Ewzda-pXDWtQblQGXB3mEDlrfLwZId86W4BK1vHvYGA7ns_Idi_6s3czyHio_wQopg8DVq-QBQY8TwWYKLeqrKh4 06/02/2025 02:36:14.032 7fe93466c588 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:36:14.032 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 460 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:36:14.619 7fe93466c588 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:36:17.476 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:36:22.479 7fe93466c588 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:36:22.480 7fe93466c588 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:36:22.480 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:22.480 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:36:22.480 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:22.480 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:36:22.481 7fe93466c588 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:36:22.483 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:22.483 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:36:22.483 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:22.483 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:22.483 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:36:22.483 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:25.299 7fe93466c588 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:36:26.480 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:36:31.486 7fe93466c588 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:36:31.575 7fe93466c588 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:36:31.575 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:31.575 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:36:31.575 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:31.576 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:36:31.576 7fe93466c588 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:36:31.576 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:31.576 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:36:31.577 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:31.577 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:31.577 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:36:31.577 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:35.489 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:36:40.494 7fe93466c588 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:36:40.494 7fe93466c588 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:36:40.494 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:40.495 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:36:40.495 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:40.495 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:36:40.495 7fe93466c588 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:36:40.495 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:40.496 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:36:40.496 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:40.496 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:40.496 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:36:40.496 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:40.576 7fe93466c588 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:36:44.497 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:36:49.502 7fe93466c588 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:36:49.502 7fe93466c588 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:36:49.502 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:49.502 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:36:49.503 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:49.503 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:36:49.503 7fe93466c588 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:36:49.503 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:49.503 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:36:49.503 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:49.503 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:49.504 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:36:49.504 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:53.505 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:36:58.509 7fe93466c588 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:36:58.509 7fe93466c588 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:36:58.509 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:58.509 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:36:58.509 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:36:58.509 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:36:58.510 7fe93466c588 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:36:58.510 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:58.510 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:36:58.510 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:58.510 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:36:58.510 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:36:58.511 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:02.509 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:37:07.512 7fe93466c588 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:37:07.512 7fe93466c588 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:37:07.512 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:07.513 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:37:07.513 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:07.513 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:37:07.513 7fe93466c588 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:37:07.513 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:07.513 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:37:07.513 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:07.513 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:07.514 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:37:07.514 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:11.512 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:37:14.647 7fe933dd7978 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQ5afKqyWnsMiEY5d43_ZzX5FShiO4yVgviwqbsBrzNs7E4CWhW0vM54dwxDDcRaTjEQf0oiSlxBN47zV_9iio33HzEMDaW9Hgr0x8aftEYKCi8vTBVkcoA8m0xjW3J7tB8Hk1Cf1b5fhuS05l4kM1Zrpc_7L5NP4VbAH_g1ysnBdfI 06/02/2025 02:37:14.648 7fe933dd7978 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:37:14.648 7fe9374ff198 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 469 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:37:14.648 7fe9374ff198 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 469 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:37:15.098 7fe933cb5f60 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQ5bXLLd3BdErTDMTUE87VuN2dr2PE_h_z_2YQLvf9RjL-iB4Ll3Cb8xfGPUUBG1XOOhtsVJOZS5fjEF7NpvNLjLqeq-2-YSYDZF9YuZjgeYoLZwxBs0zA2TlwC7_9O4AUSUtI54K8LYU7zIMdPQ_VFKtDnYq8Ha9U3sb8p_zr5_t94 06/02/2025 02:37:15.099 7fe933cb5f60 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:37:15.099 7fe933dee2e8 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 433 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:37:15.099 7fe933dee2e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 433 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:37:15.444 7fe933dd7c18 [contrail-analytics-api] [DEBUG]: resource list for database-node is None 06/02/2025 02:37:15.445 7fe92e8c8048 [contrail-analytics-api] [INFO]: db usage:{} 06/02/2025 02:37:15.450 7fe933dd7c18 [contrail-analytics-api] [DEBUG]: resource list for database-node is None 06/02/2025 02:37:15.451 7fe92e8c8048 [contrail-analytics-api] [INFO]: pending compaction tasks :{} 06/02/2025 02:37:16.515 7fe93466c588 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:37:16.515 7fe93466c588 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:37:16.515 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:16.515 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:37:16.515 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:16.515 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:37:16.516 7fe93466c588 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:37:16.517 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:16.517 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:37:16.517 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:16.517 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:16.517 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:37:16.517 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:20.519 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:37:25.525 7fe93466c588 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:37:25.525 7fe93466c588 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:37:25.525 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:25.525 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:37:25.526 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:25.526 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:37:25.526 7fe93466c588 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:37:25.526 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:25.526 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:37:25.526 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:25.527 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:25.527 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:37:25.527 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:29.525 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:37:34.531 7fe93466c588 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:37:34.531 7fe93466c588 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:37:34.531 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:34.532 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:37:34.532 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:34.532 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:37:34.532 7fe93466c588 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:37:34.532 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:34.533 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:37:34.533 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:34.533 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:34.533 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:37:34.533 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:38.532 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:37:43.534 7fe93466c588 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:37:43.535 7fe93466c588 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:37:43.535 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:43.535 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:37:43.535 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:43.536 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:37:43.536 7fe93466c588 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:37:43.536 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:43.537 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:37:43.537 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:43.537 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:43.537 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:37:43.537 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:47.536 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:37:52.538 7fe93466c588 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:37:52.538 7fe93466c588 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:37:52.539 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:52.539 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:37:52.539 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:37:52.539 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:37:52.539 7fe93466c588 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:37:52.540 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:52.540 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:37:52.540 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:52.540 7fe93466c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:52.540 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:37:52.540 7fe93466c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:37:56.539 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:38:01.542 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:38:01.543 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:38:01.543 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:01.543 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:38:01.543 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:01.543 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:38:01.543 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:38:01.544 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:01.544 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:38:01.544 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:01.544 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:01.544 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:38:01.544 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:05.547 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:38:09.430 7fe933deeac8 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 06/02/2025 02:38:10.550 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:38:10.550 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:38:10.550 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:10.551 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:38:10.551 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:10.551 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:38:10.551 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:38:10.551 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:10.552 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:38:10.552 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:10.552 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:10.552 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:38:10.552 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:10.877 7fe92e8c6978 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 06/02/2025 02:38:14.553 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:38:15.702 7fe933dcef60 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQ6XMt9yEpCdxn87_0Yw664r-FPIUseoDUpxPrFVK5tdthR3CK73FAx1tXdpH8Cb7QHsy1rQzwNnd4uBUiQwcQnlPnhrhE7IxKF9JUU5J6_DfriYiuQ44E-J3cqHxdcSP6hYt4AsJAie7mmCRWazwGdtV9op2BWuuDQburT6xJ7-nT0 06/02/2025 02:38:15.702 7fe933dcef60 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:38:15.704 7fe933dd7390 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 1562 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:38:15.704 7fe933dd7390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 1562 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:38:16.248 7fe933dcef60 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQ6Yr19BRMqjcntLCsMr2iT7YLCK6g4yQcsCkRD9wWdtKaQEi51qQrCqowiQzd-mXeZytIk3x5QCuUxSY_pcC8PWNY68m9ecbEecWBzzCB1MRQADtdGuqrpqNmUji_KTtAUFGapJITCPO95LjXEA3Gx1SWyk528hENXV6ihd7kyJOu8 06/02/2025 02:38:16.248 7fe933dcef60 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:38:16.249 7fe933dee048 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 565 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:38:16.249 7fe933dee048 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 565 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:38:19.557 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:38:19.557 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:38:19.557 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:19.557 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:38:19.557 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:19.557 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:38:19.558 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:38:19.558 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:19.558 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:38:19.558 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:19.558 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:19.558 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:38:19.558 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:23.558 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:38:24.666 7fe933dce588 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:38:28.562 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:38:28.562 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:38:28.562 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:28.562 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:38:28.562 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:28.563 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:38:28.563 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:38:28.563 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:28.563 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:38:28.563 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:28.563 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:28.563 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:38:28.564 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:32.562 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:38:37.565 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:38:37.565 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:38:37.566 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:37.566 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:38:37.566 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:37.566 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:38:37.566 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:38:37.567 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:37.567 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:38:37.567 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:37.567 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:37.567 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:38:37.567 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:41.566 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:38:46.568 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:38:46.569 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:38:46.569 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:46.569 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:38:46.569 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:46.569 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:38:46.570 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:38:46.570 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:46.570 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:38:46.570 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:46.570 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:46.570 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:38:46.570 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:50.569 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:38:55.574 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:38:55.575 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:38:55.575 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:55.575 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:38:55.575 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:38:55.575 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:38:55.575 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:38:55.576 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:55.576 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:38:55.576 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:55.576 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:55.576 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:38:55.576 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:38:59.577 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:39:04.582 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:39:04.582 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:39:04.582 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:04.583 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:39:04.583 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:04.583 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:39:04.583 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:39:04.583 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:04.583 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:39:04.583 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:04.583 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:04.583 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:39:04.584 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:08.582 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:39:13.586 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:39:13.586 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:39:13.586 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:13.586 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:39:13.586 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:13.586 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:39:13.587 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:39:13.587 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:13.587 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:39:13.587 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:13.587 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:13.587 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:39:13.587 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:16.803 7fe92e8c6978 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQ7U7AG8gnD1pywjCXwpgPZicTc2BmQB6z0ngCtJRm7kLA1tXHrOrACzxxrDve7OxKlSlntPbHHyEPROqw7dAdgefijizFVLfks5-J3QWgMoqbfQlnzMwob2B1Yn2YpHb3FX54Z-flgw0a0iIqLk7gq4ur54DAGof2m40cpw7xW6tHQ 06/02/2025 02:39:16.803 7fe92e8c6978 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:39:16.804 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 517 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:39:17.252 7fe92e8c6978 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQ7V9R5q60kkwihvnzevSGDwSw_NED7ee2NR3ZzvXXYs_IjVgW2zIslSSNsTKBtYqbOfl1pKNF8UCpecNoC6MlVHz5ZNyK446US1HBv9A5zEUwv8pcNuiB5fzVCL-gBAjxGG6S0QboZrY6_aWjqaz2yJfmkNV9g7YLHiLg5BC-hbI24 06/02/2025 02:39:17.252 7fe92e8c6978 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:39:17.252 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 472 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:39:17.586 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:39:22.590 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:39:22.591 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:39:22.591 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:22.591 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:39:22.591 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:22.592 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:39:22.592 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:39:22.592 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:22.593 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:39:22.593 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:22.593 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:22.594 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:39:22.594 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:26.591 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:39:31.593 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:39:31.593 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:39:31.593 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:31.593 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:39:31.594 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:31.594 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:39:31.594 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:39:31.594 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:31.594 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:39:31.594 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:31.594 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:31.594 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:39:31.595 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:35.597 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:39:40.599 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:39:40.599 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:39:40.600 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:40.600 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:39:40.600 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:40.600 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:39:40.600 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:39:40.601 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:40.601 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:39:40.601 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:40.601 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:40.601 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:39:40.601 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:44.602 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:39:49.605 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:39:49.605 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:39:49.605 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:49.605 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:39:49.605 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:49.605 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:39:49.606 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:39:49.606 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:49.606 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:39:49.606 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:49.606 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:49.606 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:39:49.606 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:53.605 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:39:58.609 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:39:58.609 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:39:58.609 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:58.609 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:39:58.609 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:39:58.609 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:39:58.610 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:39:58.610 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:58.610 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:39:58.610 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:58.610 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:39:58.610 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:39:58.610 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:02.611 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:40:07.614 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:40:07.614 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:40:07.614 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:07.614 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:40:07.615 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:07.615 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:40:07.615 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:40:07.615 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:07.616 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:40:07.616 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:07.616 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:07.616 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:40:07.616 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:11.615 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:40:16.617 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:40:16.618 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:40:16.618 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:16.618 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:40:16.618 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:16.618 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:40:16.618 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:40:16.619 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:16.619 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:40:16.619 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:16.619 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:16.619 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:40:16.619 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:17.789 7fe92e8c6978 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQ8RbfNaLM1Q8w8nbr4TbLKsRutH80z2T9XD96VLVBjCbNcEFd6fuVXM2n6rFz51CvfCdv68_ZWdei1DdaIViMlLGF1-DPR4MM76wmhfXORsnWonuHGWEdulch1XgcOh8ffj5e4zoajAF1PfChcj9HDX___PkoBAedkLjuwHeN8Vzew 06/02/2025 02:40:17.789 7fe92e8c6978 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:40:17.790 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 590 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:40:17.943 7fe92e8c6978 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:40:18.310 7fe92e8c6978 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQ8SCRHGmHeoFlug7eh2Y6iIrZ5nS7uNgUgZSp_73lr-nRxesBgAv3wkRh0BcGV7Jym5XQl2RwcdpsLDOSxaQl7hN0j_Yy4FxstmYCoXdL4JW07-3fXzZPH9cJ4QVu1aCdfMZeBX43eg4Mvlf13iQjZpgPvoVKfHSjlqkgbc4szX98g 06/02/2025 02:40:18.310 7fe92e8c6978 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:40:18.311 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 691 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:40:20.619 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:40:25.625 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:40:25.625 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:40:25.625 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:25.625 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:40:25.625 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:25.625 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:40:25.626 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:40:25.626 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:25.626 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:40:25.626 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:25.626 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:25.626 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:40:25.626 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:28.375 7fe92e8c6978 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:40:29.625 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:40:34.629 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:40:34.629 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:40:34.629 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:34.629 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:40:34.629 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:34.629 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:40:34.630 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:40:34.630 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:34.630 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:40:34.630 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:34.630 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:34.630 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:40:34.630 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:38.636 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:40:40.612 7fe933e62ac8 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:40:43.642 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:40:43.642 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:40:43.642 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:43.643 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:40:43.643 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:43.643 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:40:43.643 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:40:43.643 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:43.643 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:40:43.643 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:43.644 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:43.644 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:40:43.644 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:47.643 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:40:52.647 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:40:52.647 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:40:52.647 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:52.647 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:40:52.648 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:40:52.648 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:40:52.648 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:40:52.648 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:52.648 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:40:52.648 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:52.648 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:52.648 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:40:52.649 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:40:56.648 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:41:01.650 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:41:01.650 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:41:01.650 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:01.650 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:41:01.650 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:01.650 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:41:01.651 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:41:01.651 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:01.651 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:41:01.651 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:01.651 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:01.651 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:41:01.651 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:05.653 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:41:10.658 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:41:10.658 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:41:10.658 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:10.658 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:41:10.658 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:10.659 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:41:10.659 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:41:10.659 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:10.659 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:41:10.659 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:10.659 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:10.659 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:41:10.659 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:14.660 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:41:18.892 7fe933dc8c18 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQ9OVtYw1Mu4oeLaFH2lNdHgx5X4xqHQob-IPuC9gTSFoHvJAsivQTzSJDPqoYashQkJ-SNL7ut-5zlriO_ER8SXnQ9Z2QzZrWq1M81eUylYqbC-7JUqoNn4CTCc44Mwu8nl9njT7n1qo_arTjTtA1OUwtaijGiEQp6oBmpkXVvwwZY 06/02/2025 02:41:18.892 7fe933dc8c18 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:41:18.893 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 423 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:41:18.893 7fe93466c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 423 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:41:19.319 7fe933dc8c18 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQ9PbbHJdSjTELf33xF1q47EkdCDS6K1yMkBGOM6gHCjb4ZZifJmlBA0kApNpTgLe6Qv46_276YjqVixQ07yWyB6jhOse6iU3eSiiYXWknuXg2mvD55IwY9fwMSfiMhKs_Fs3FE5p6iZd4UXY7KTcKQAx9JTGWrI2MiuPZARPooer_g 06/02/2025 02:41:19.319 7fe933dc8c18 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:41:19.320 7fe933e6ac18 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 478 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:41:19.320 7fe933e6ac18 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 478 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:41:19.662 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:41:19.662 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:41:19.662 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:19.663 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:41:19.663 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:19.663 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:41:19.663 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:41:19.663 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:19.664 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:41:19.664 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:19.664 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:19.664 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:41:19.664 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:23.665 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:41:28.667 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:41:28.667 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:41:28.667 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:28.667 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:41:28.667 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:28.667 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:41:28.668 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:41:28.668 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:28.668 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:41:28.668 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:28.668 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:28.668 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:41:28.668 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:32.668 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:41:37.671 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:41:37.671 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:41:37.671 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:37.671 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:41:37.671 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:37.671 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:41:37.672 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:41:37.672 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:37.673 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:41:37.673 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:37.673 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:37.673 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:41:37.673 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:41.671 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:41:46.673 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:41:46.673 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:41:46.673 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:46.674 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:41:46.674 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:46.674 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:41:46.674 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:41:46.675 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:46.675 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:41:46.675 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:46.675 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:46.675 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:41:46.675 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:50.675 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:41:55.681 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:41:55.681 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:41:55.681 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:55.681 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:41:55.681 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:41:55.681 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:41:55.682 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:41:55.682 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:55.682 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:41:55.682 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:55.682 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:55.682 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:41:55.682 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:41:59.683 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:42:04.689 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:42:04.689 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:42:04.689 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:04.689 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:42:04.689 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:04.689 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:42:04.690 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:42:04.690 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:04.690 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:42:04.690 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:04.690 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:04.690 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:42:04.690 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:08.690 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:42:13.693 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:42:13.693 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:42:13.693 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:13.693 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:42:13.693 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:13.693 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:42:13.694 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:42:13.694 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:13.694 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:42:13.695 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:13.695 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:13.695 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:42:13.695 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:17.694 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:42:19.879 7fe933deb4e0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQ-LwlzcOcIh21WKcs1XPj4CD8Kl7r4FGzZmxkE8Hzqoa-sGHPjM9foyMA34PaWn4VZeI0FSjZobfnqBT_hJbwiH2H0XUZLF8zLW1DICU0ynm4t1WHZxWPmn-YDFLAdeG5PGjlRODtY208Athl85pj2rjhFoObIzfjdrIJx0F8jd6Jo 06/02/2025 02:42:19.879 7fe933deb4e0 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:42:19.880 7fe933e62a20 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 630 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:42:19.880 7fe933e62a20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 630 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:42:20.321 7fe933deb4e0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQ-MS9mMD0CFYXxugWbTTH4A6a1IXDVWzV5PBksjpKnWOTLcLjQgTBBQ-_LDQVRekO0sNMgy4mElzIrlM-yZ4EeSVjBqB5HQZAZ7RCVBYU19dgMRzsnxSJL1Up2Fr23REdgnf5pqcVsAW46sh8HKXKKFRIhKSEwK48amGEYZk8Hm4aQ 06/02/2025 02:42:20.321 7fe933deb4e0 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:42:20.322 7fe933e042e8 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 617 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:42:20.322 7fe933e042e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 617 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:42:22.697 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:42:22.697 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:42:22.697 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:22.697 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:42:22.697 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:22.697 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:42:22.698 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:42:22.698 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:22.698 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:42:22.698 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:22.698 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:22.698 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:42:22.699 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:26.697 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:42:31.699 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:42:31.699 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:42:31.700 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:31.700 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:42:31.700 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:31.700 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:42:31.700 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:42:31.700 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:31.701 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:42:31.701 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:31.701 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:31.701 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:42:31.701 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:35.704 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:42:40.709 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:42:40.709 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:42:40.709 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:40.710 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:42:40.710 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:40.710 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:42:40.710 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:42:40.710 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:40.710 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:42:40.710 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:40.710 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:40.711 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:42:40.711 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:44.710 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:42:49.714 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:42:49.714 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:42:49.714 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:49.714 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:42:49.714 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:49.714 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:42:49.715 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:42:49.715 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:49.715 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:42:49.716 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:49.716 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:49.716 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:42:49.716 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:53.716 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:42:58.720 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:42:58.720 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:42:58.720 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:58.720 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:42:58.721 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:42:58.721 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:42:58.721 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:42:58.721 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:58.722 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:42:58.722 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:58.722 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:42:58.722 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:42:58.722 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:02.721 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:43:07.724 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:43:07.724 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:43:07.724 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:07.724 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:43:07.725 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:07.725 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:43:07.725 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:43:07.725 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:07.725 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:43:07.725 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:07.725 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:07.725 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:43:07.726 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:09.443 7fe92e8c6978 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 06/02/2025 02:43:10.879 7fe92e8c6978 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 06/02/2025 02:43:11.725 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:43:16.661 7fe933dd0a20 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:43:16.727 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:43:16.727 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:43:16.727 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:16.728 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:43:16.728 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:16.728 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:43:16.728 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:43:16.728 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:16.729 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:43:16.729 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:16.729 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:16.729 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:43:16.729 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:20.729 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:43:20.870 7fe937d9a390 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQ_ItxBTm2fcsON1aCnWkbugxhQphpP3Jec9v8HmYyp2qPdOtAz_SGij_LLuP7Ex5OLkmjsbqrAGt_mSlWYT1TZrpGjzef79DciG3qqgrI-8RJRlLExKQQEiCbRhUezrO_Jzk4RHo18tqUnZcdaV5x8yTK9XlNAUrYYN5-Cx-7JfFAg 06/02/2025 02:43:20.871 7fe937d9a390 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:43:20.871 7fe9362658d0 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 464 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:43:20.871 7fe9362658d0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 464 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:43:21.323 7fe937d9a390 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPQ_JSpbKZDgy_QDNE9nQyPPhDE54AIKIKOPQaIpzCnAhQJMJ1twAW8CdwH9as4LOe-9wRk3_BS_ScRCGdwkVU4or918Sm-KJGt-3WbjnmtXokgEpt7jriVsPKITkTt3pQ0NwCWsAoZMaCEM3NrW2IF27FyJxmA96yw6El6H78XTzlS0 06/02/2025 02:43:21.324 7fe937d9a390 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:43:21.324 7fe933e624e0 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 541 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:43:21.325 7fe933e624e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 541 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:43:25.732 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:43:25.733 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:43:25.733 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:25.733 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:43:25.733 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:25.733 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:43:25.733 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:43:25.733 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:25.734 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:43:25.734 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:25.734 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:25.734 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:43:25.734 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:29.736 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:43:34.741 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:43:34.741 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:43:34.741 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:34.741 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:43:34.741 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:34.741 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:43:34.742 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:43:34.742 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:34.742 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:43:34.742 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:34.742 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:34.742 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:43:34.742 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:38.743 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:43:43.747 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:43:43.747 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:43:43.747 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:43.748 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:43:43.748 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:43.748 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:43:43.748 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:43:43.748 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:43.748 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:43:43.748 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:43.749 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:43.749 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:43:43.749 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:47.748 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:43:52.751 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:43:52.752 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:43:52.752 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:52.752 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:43:52.752 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:43:52.752 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:43:52.753 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:43:52.753 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:52.753 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:43:52.753 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:52.753 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:52.753 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:43:52.753 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:43:56.752 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:44:01.755 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:44:01.755 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:44:01.755 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:01.755 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:44:01.755 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:01.755 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:44:01.756 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:44:01.756 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:01.757 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:44:01.757 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:01.757 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:01.758 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:44:01.758 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:05.757 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:44:10.763 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:44:10.763 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:44:10.764 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:10.764 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:44:10.764 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:10.764 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:44:10.764 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:44:10.765 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:10.765 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:44:10.765 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:10.765 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:10.765 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:44:10.765 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:14.767 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:44:19.771 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:44:19.772 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:44:19.772 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:19.772 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:44:19.772 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:19.772 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:44:19.773 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:44:19.773 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:19.773 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:44:19.773 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:19.773 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:19.774 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:44:19.774 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:21.850 7fe92e8c6978 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPRAF2VhfGiFGdTxbQSaLPNMExy0rraS6_tIHwgJ8I0m3ZjwexuX_hMbkojVUUGui5hvGuzZyuoQ-1J8TG-25YfAaPrNbS25f63wulc_AfxAAkXyyF1s-2HRpdu4yoP8-7YLSjhITK-42e3lNGfWBgnbppX7nzNA6YkWXAYfEFikYkvE 06/02/2025 02:44:21.850 7fe92e8c6978 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:44:21.850 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 488 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:44:22.313 7fe92e8c6978 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPRAG_lRgcix5w0-u7QluXUdgsJODw3j51OpBGkgypj-c-Vjfb3MBDT4MVMyIPxHHwZceJLrFbOnhmASPT96F3iLQnvPyO8b8GV0XB4OsOoj_bRrocHKMY2AkRHRpZ6lMRx2MjQsA5Lp5Bb0vQwt8KMQX0-feo72XjAmr8ik_eR_LjLQ 06/02/2025 02:44:22.314 7fe92e8c6978 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:44:22.314 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 541 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:44:23.773 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:44:28.777 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:44:28.777 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:44:28.777 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:28.777 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:44:28.777 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:28.778 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:44:28.778 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:44:28.778 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:28.778 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:44:28.778 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:28.779 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:28.779 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:44:28.779 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:32.778 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:44:37.782 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:44:37.782 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:44:37.782 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:37.782 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:44:37.782 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:37.782 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:44:37.783 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:44:37.783 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:37.784 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:44:37.784 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:37.784 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:37.784 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:44:37.784 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:41.782 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:44:46.784 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:44:46.784 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:44:46.784 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:46.784 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:44:46.784 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:46.784 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:44:46.785 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:44:46.785 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:46.785 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:44:46.785 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:46.785 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:46.785 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:44:46.785 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:50.787 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:44:55.793 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:44:55.793 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:44:55.793 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:55.793 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:44:55.793 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:44:55.793 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:44:55.794 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:44:55.794 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:55.794 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:44:55.794 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:55.794 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:55.794 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:44:55.794 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:44:59.795 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:45:04.798 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:45:04.798 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:45:04.799 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:04.799 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:45:04.799 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:04.799 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:45:04.799 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:45:04.799 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:04.800 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:45:04.800 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:04.800 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:04.800 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:45:04.800 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:08.800 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:45:13.803 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:45:13.803 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:45:13.803 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:13.803 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:45:13.803 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:13.803 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:45:13.804 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:45:13.804 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:13.804 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:45:13.804 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:13.804 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:13.804 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:45:13.804 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:17.804 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:45:22.809 7fe92e8c6978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:45:22.809 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:45:22.810 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:22.810 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:45:22.810 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:22.810 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:45:22.811 7fe92e8c6978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:45:22.811 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:22.811 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:45:22.811 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:22.811 7fe92e8c6978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:22.811 7fe92e8c6978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:45:22.811 7fe92e8c6978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:22.978 7fe933deb438 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPRBCcFrjmMM-5Bpz2hglAn8ZG4_CgDhdY1zH30n2lbvIAeRTTnPyYgwNFNw9_wFyG2h19JF3UYwpC5B8QB2oNiqc60yByZsdiQn9YhGMlMjES4iKXZYK18FpEmn2m6zLNCzrXRvdEeCI7sZOSrACzBBe0FcIC54tpL8daFtBW7iY9mc 06/02/2025 02:45:22.978 7fe933deb438 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:45:22.979 7fe933deb438 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 484 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:45:23.794 7fe933deb438 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPRBDzLT-DaJsD6wbFQ-WonPHJ0S4Jn9_rXPXbz1hk8xaQHWr_c4Dta2tOWaIQNw_cKbWk9HjfHFau6W_OjhcbOFvWSBTk5HJ12D5alPBmWX_rldSYHftJUR1YcWncprcxyU_A8QyiQpQyG6gmgKOGQOkQ5N7ksTzZW1uqeCzN1U9PdE 06/02/2025 02:45:23.794 7fe933deb438 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:45:23.794 7fe933deb438 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 429 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:45:26.811 7fe933deb438 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:45:31.813 7fe933deb438 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:45:31.814 7fe933deb438 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:45:31.814 7fe933deb438 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:31.814 7fe933deb438 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:45:31.814 7fe933deb438 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:31.814 7fe933deb438 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:45:31.815 7fe933deb438 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:45:31.815 7fe933deb438 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:31.815 7fe933deb438 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:45:31.815 7fe933deb438 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:31.815 7fe933deb438 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:31.815 7fe933deb438 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:45:31.815 7fe933deb438 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:35.814 7fe933deb438 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:45:40.820 7fe933deb438 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:45:40.821 7fe933deb438 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:45:40.821 7fe933deb438 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:40.821 7fe933deb438 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:45:40.821 7fe933deb438 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:40.821 7fe933deb438 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:45:40.821 7fe933deb438 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:45:40.822 7fe933deb438 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:40.822 7fe933deb438 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:45:40.822 7fe933deb438 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:40.822 7fe933deb438 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:40.822 7fe933deb438 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:45:40.822 7fe933deb438 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:44.823 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:45:49.827 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:45:49.827 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:45:49.827 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:49.827 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:45:49.828 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:49.828 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:45:49.828 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:45:49.828 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:49.829 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:45:49.829 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:49.829 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:49.829 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:45:49.829 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:53.829 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:45:55.774 7fe933dc8c18 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:45:58.832 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:45:58.832 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:45:58.832 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:58.832 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:45:58.832 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:45:58.832 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:45:58.833 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:45:58.833 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:58.833 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:45:58.833 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:58.833 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:45:58.833 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:45:58.833 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:02.834 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:46:05.846 7fe934691390 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:46:07.837 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:46:07.845 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:46:07.845 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:07.845 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:46:07.845 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:07.845 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:46:07.846 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:46:07.846 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:07.846 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:46:07.846 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:07.846 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:07.846 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:46:07.847 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:11.837 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:46:16.787 7fe933dceac8 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:46:16.839 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:46:16.839 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:46:16.839 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:16.839 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:46:16.839 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:16.839 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:46:16.840 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:46:16.840 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:16.840 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:46:16.840 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:16.840 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:16.840 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:46:16.840 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:20.843 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:46:24.376 7fe933e6ae10 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPRCAjbbqSV0OEBZ3Fu-CJ-xhVvIJtMW3rRszy2mvi2cQZhPUVA9axcWEnKNoeQrJ-wkbaiCu__vQ1If6yWFt7lok_iSNZJwPyKiqOPxUMxjRAvExEkCRxb8tjxomqFuu9bS12vbdCNQ9ljwx7Oz2LhHXVYp0tIzgpcBz_mMoACHLhFc 06/02/2025 02:46:24.376 7fe933e6ae10 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:46:24.377 7fe933dd9630 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 450 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:46:24.377 7fe933dd9630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 450 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:46:24.834 7fe933e6ae10 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPRCAFausHmJOuKfjyBel-kvHjpBIT_z2d5u43ZtQ0e6mUO7_VjsVWkSABuVak1PrQ4vWqCOxk_2HZ_l9wVoO1l3kw2YQFkSmzYoGec2PLVblizdWhs6Xz6Py4iOMA8kV8CU2Qtpess8pdvuTc2tB-tKq5ZVawu3THIcQciCnQudyiV8 06/02/2025 02:46:24.835 7fe933e6ae10 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:46:24.836 7fe933dc82e8 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 1873 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:46:24.837 7fe933dc82e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 1873 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:46:25.846 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:46:25.846 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:46:25.846 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:25.847 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:46:25.847 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:25.847 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:46:25.847 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:46:25.847 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:25.848 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:46:25.848 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:25.848 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:25.848 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:46:25.848 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:29.848 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:46:34.853 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:46:34.853 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:46:34.853 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:34.853 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:46:34.853 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:34.853 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:46:34.854 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:46:34.854 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:34.855 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:46:34.855 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:34.855 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:34.855 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:46:34.855 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:38.855 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:46:43.858 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:46:43.859 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:46:43.859 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:43.859 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:46:43.859 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:43.859 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:46:43.860 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:46:43.860 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:43.860 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:46:43.860 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:43.860 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:43.860 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:46:43.860 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:47.859 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:46:52.862 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:46:52.862 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:46:52.862 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:52.862 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:46:52.863 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:46:52.863 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:46:52.863 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:46:52.863 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:52.863 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:46:52.863 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:52.863 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:52.864 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:46:52.864 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:46:56.863 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:47:01.865 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:47:01.866 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:47:01.866 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:01.866 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:47:01.866 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:01.866 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:47:01.867 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:47:01.867 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:01.867 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:47:01.867 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:01.867 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:01.868 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:47:01.868 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:05.867 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:47:10.873 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:47:10.873 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:47:10.873 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:10.873 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:47:10.874 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:10.874 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:47:10.874 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:47:10.874 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:10.874 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:47:10.874 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:10.874 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:10.874 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:47:10.875 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:14.877 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:47:15.457 7fe933dee390 [contrail-analytics-api] [DEBUG]: resource list for database-node is None 06/02/2025 02:47:15.458 7fe92e8c8048 [contrail-analytics-api] [INFO]: db usage:{} 06/02/2025 02:47:15.463 7fe933dcea20 [contrail-analytics-api] [DEBUG]: resource list for database-node is None 06/02/2025 02:47:15.464 7fe92e8c8048 [contrail-analytics-api] [INFO]: pending compaction tasks :{} 06/02/2025 02:47:19.881 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:47:19.881 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:47:19.882 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:19.882 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:47:19.882 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:19.882 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:47:19.882 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:47:19.883 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:19.883 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:47:19.883 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:19.883 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:19.883 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:47:19.883 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:23.882 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:47:25.465 7fe933dca2e8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPRC9kb5BoGEeYIeHzcOEPY4TPpWd1X-Pk6ew7N6ZZT2ImM7fzqEiJjHwstCcubK5E4njIRA_1TK6j0r-ICSNa5pycTPotSUkv_G4dfIqg4OCYUTidL9ld_Txpi6CFxUTBumWoLJn8fMpM7UWloqMvOPvOcKQBwQiPogrf0yTecaT0oY 06/02/2025 02:47:25.466 7fe933dca2e8 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:47:25.466 7fe933dd94e0 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 469 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:47:25.466 7fe933dd94e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 469 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:47:25.946 7fe933dca2e8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPRC9rTnwYsXEoTnKfLHDvwxoZFUuC0kE9_q4cqzD70wDQjuWlE8_5ghu3FSweoItlinBMyBJsCvjfFbnuiTS59X-vCaA_wnsURa4B-LsHFX8rn4bjfSrhnQ1lXbS0wEDaeFW7mGFBf6mQfBzMO4YMrFNr734zlk4YYVsFwOUfYfi93w 06/02/2025 02:47:25.947 7fe933dca2e8 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:47:25.947 7fe933e04780 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 444 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:47:25.948 7fe933e04780 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 444 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:47:27.247 7fe933dca2e8 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/02/2025 02:47:28.886 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:47:28.886 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:47:28.886 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:28.886 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:47:28.886 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:28.886 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:47:28.887 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:47:28.887 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:28.887 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:47:28.887 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:28.887 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:28.887 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:47:28.887 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:32.887 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:47:37.889 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:47:37.889 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:47:37.889 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:37.889 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:47:37.889 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:37.889 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:47:37.890 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:47:37.890 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:37.890 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:47:37.890 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:37.891 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:37.891 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:47:37.891 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:41.889 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:47:46.891 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:47:46.892 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:47:46.892 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:46.892 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:47:46.892 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:46.892 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:47:46.892 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:47:46.893 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:46.893 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:47:46.893 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:46.893 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:46.893 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:47:46.893 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:50.895 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:47:55.901 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:47:55.901 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:47:55.901 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:55.901 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:47:55.901 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:47:55.901 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:47:55.902 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:47:55.902 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:55.902 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:47:55.902 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:55.902 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:55.902 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:47:55.902 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:47:59.905 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:48:04.909 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:48:04.909 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:48:04.910 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:48:04.910 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:48:04.911 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:48:04.911 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:48:04.911 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:48:04.911 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:04.911 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:48:04.912 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:04.912 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:04.912 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:48:04.912 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:08.912 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:48:09.436 7fe92e8c9630 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 06/02/2025 02:48:10.871 7fe92e8c9630 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 06/02/2025 02:48:13.913 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:48:13.914 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:48:13.914 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:48:13.914 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:48:13.914 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:48:13.914 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:48:13.915 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:48:13.915 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:13.915 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:48:13.915 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:13.915 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:13.915 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:48:13.915 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:17.915 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:48:22.918 7fe935cad390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 06/02/2025 02:48:22.918 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/02/2025 02:48:22.918 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:48:22.918 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/02/2025 02:48:22.919 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/02/2025 02:48:22.919 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/02/2025 02:48:22.919 7fe935cad390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/02/2025 02:48:22.919 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:22.919 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-542-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.129:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.129:6379 server_addrs = [ 10.0.0.129:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.129:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.129:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.129:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/02/2025 02:48:22.919 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:22.919 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:22.919 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-542-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748830035407834 collector_name = collector_ip = 10.0.0.129:8086 collector_list = [ 10.0.0.129:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 06/02/2025 02:48:22.919 7fe935cad390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/02/2025 02:48:26.516 7fe935cad390 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPRD68YCg00AViHrKQ_qyGkTGHkR9yjo_kPpTAlTOa6tmTe9yK2vsllN6mcUHP4-zkZDrb64uJBFyB7DkkkJpQwdvICiCyeATD3koDfKw2CRmelhg0UDvq2wmX7jrHwE09W16vVmQgF_56z_zanmFainpZBR59g9uajcNQULQ4SwUaV4 06/02/2025 02:48:26.517 7fe935cad390 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:48:26.517 7fe935cad390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 955 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:48:26.919 7fe935cad390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/02/2025 02:48:27.009 7fe933e6a390 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoPRD6PUMji7ra9dbucpvxS2Mh6eiI1acVpIqA3dSubrtFofJcx85gNF-IZjsZz6tNRoOd8PFXokFpZXPeVtT9w4Gc7cF7Elj1Ge1G3zb0thraIpVuArLZbmqOJrtC8Wx12jMtAlmWM_JRPcBG4giDTM7URHzPf7p0VIFnG6ycKQhBu_k 06/02/2025 02:48:27.009 7fe933e6a390 [contrail-analytics-api] [DEBUG]: user resources are None 06/02/2025 02:48:27.010 7fe933dc8780 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 459 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:48:27.010 7fe933dc8780 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.129 object_type = vrouter request_url = https://10.0.0.129:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 459 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-542-1 >> 06/02/2025 02:48:29.074 7fe933dc8780 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map